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RELIABILITY  PROGRAMS  FOR  NONELECTRONIC  DESIGNS 
VOLUME  II:  RELIABILITY  TASKS 


SUMMARY 


Current  military  standards  for  reliability  programs,  reliability 
predictions  and  qualification  tasting  were  written  primarily  for  elec¬ 
tronic  equipment  where  component  standardization  and  the  valid  assumption 
of  an  exponential  failure  rate  permit  their  direct  application.  These 
electronic  systems,  however,  often  contain  nonelectronic  assemblies  that 
are  critical  to  operational  readiness,  mission  success  or  logistic 
support.  Examples  of  such  nonelectronic  assemblies  include  antenna 
positioning  mechanisms,  tape  and  disk  drives,  and  printers. 

Typical  tasks  Imposed  In  existing  contracts  require  a  reliability 
program  In  accordance  with  MIL-STD-785,  a  reliability  prediction  In 
accordance  with  MIL-STD-756  and  MIL-HDBK-217  and  reliability  testing  In 
accordance  with  MIL-STD-781,  These  documents  were  prepared  primarily  for 
electronic  equipment  and  the  underlying  assumptions  and  philosophies 
reflected  therein  do  not  always  apply  to  a  particular  nonelectronic 
development  program. 

Analytical  techniques,  testing  procedures  and  program  controls  can 
be  made  more  cost  effective  by  tailoring  current  standards  to  a  particular 
nonelectronic  development  program.  The  extent  of  tailoring  depends  upon 
the  type  equipment  being  developed.  Previous  experience  with  applicable 
standards,  the-  quantity  of  equipments  to  be  produced,  budget  constraints, 
and  many  other  factors  contribute  toward  an  engineering  decision  as  to 
the  extent  which  current  standards  can  be  applied  to  a  particular  non¬ 
electronic  design.  To  help  Identify  these  characteristics  and  formulate 
a  set  of  criteria  on  which  to  base  recommended  reliability  program  tasks, 


a  questionnaire  on  "Reliability  Programs  for  Nonelectronic  Designs"  was 
developed  by  the  Rome  Air  Development  Center  (RADC).  Four  hundred  of 
these  questionnaires  were  distributed  throughout  the  Department  of 
Defense  and  related  Industries,  and  over  one  hundred  completed 
questionnaires  were  returned.  Volume  I  of  this  report  contains  a 
detailed  description  of  the  survey  and  a  compilation  and  statistical 
summary  of  questionnaire  responses. 

Results  of  the  survey  Indicated  that  the  characteristics  which 
distinguish  electronic  from  nonelectronic  reliability  programs  can  be 
concentrated  In  the  areas  of  reliability  analysis  and  reliability 
demonstration  tests.  The  reliability  tasks  as  Included  In  MIL-STD-785 
are  sometimes  applicable  to  a  total  system  containing  both  electronic  and 
nonelectronic  designs.  Individual  nonelectronic  equipments  or  total 
mechanical  systems  will  require  a  unique  approach  to  planning  the 
analysis  and/or  testing  program.  The  purpose  of  this  Volume  II  report  Is 
to  recommend  guidelines  for  establishing  analysis  and  testing 
requirements  for  nonelectronic  designs  and  to  describe  analysis  and 
testing  methods  which  are  unique  to  nonelectronic  designs. 

The  guidelines  contained  In  this  report  were  prepared  from  opinions 
expressed  by  respondees  of  the  survey  combined  with  results  of  a  litera¬ 
ture  search  and  an  Investigation  of  ongoing  and  past  development  programs. 
Comments  from  respondees  of  the  survey  reflect  considerable  experience 
and  knowledge  on  reliability  principles  and  practices,  and  the  purpose  of 
this  report  Is  to  present  the  opinions  expressed  by  respondees  In  the 
form  of  applications  oriented  guidelines  for  the  reliability  engineer  who 
has  the  responsibility  for  specifying  or  performing  reliability  tasks  and 
Interfacing  with  mechanical  designers  and  stress  analysts. 

This  report  emphasizes  the  distinguishing  characteristics  of  non¬ 
electronic  designs  which  require  tailoring  of  established  specifications 


and  standards.  The  guidelines  consider  such  trade-offs  and  program  con¬ 
straints  as  mission  criticality,  program  dollars  and  available 
development  time.  A  brief  mention  or  total  absence  of  a  particular 
reliability  task  In  this  report  should  not  be  Interpreted  as  though  that 
task  Is  not  Important.  MIt-STD-785  and  supporting  documents  provide  the 
necessary  requirements  to  perform  reliability  tasks  for  electronic  and 
nonelectronic  equipments  and  these  documents  should  be  used  as  the  basis 
for  design  of  any  reliability  program.  This  report  emphasizes  those 
tasks  which  require  significant  differences  In  approach  between 
electronic  and  nonelectronic  reliability  programs.  ,u»y  recommended  tasks 
contained  In  this  report  are  Intended  to  support  those  contained  In 
MIL-STD-785  and  supporting  documents  with  consideration  given  to  tne 
unique  requirements  Imposed  by  nonelectronic  designs. 

MIL-STD-785  partitions  reliability  tasks  Into  three  distinct 
sections  Including  Task  Section  100,  Program  Surveillance  and  Control; 
Task  Section  200,  Design  and  Evaluation;  and  Task  Section  300, 
Development  and  Production  Testing.  This  report  has  been  subdivided  In  a 
similar  manner.  Section  1  of  this  volume  contains  some  recommended 
approaches  for  establishing  reliability  programs  and  controls  to  be 
developed  by  the  procuring  activity  prior  to  release  of  a  Request  For 
Proposal  (RFP)  and  by  the  contractor  in  preparing  the  reliability  program 
plan.  The  reliability  engineer  encounters  a  great  deal  of  difficulty  In 
predicting  reliability  of  a  nonelectronic  design  and  must  Interface  with 
a  number  of  specialists.  The  mechanical  designer  has  detailed  knowledge 
of  material  and  lubrication  properties,  clearance  requirements  and  many 
other  design  related  factors  which  influence  equipment  reliability.  The 
stress  analyst  can  provide  knowledge  of  fatigue  life,  crack  growth 
potential  and  other  specialized  Information  needed  for  the  reliability 
prediction.  The  second  section  of  this  volume  i  resents  some  of  the 
Information  requirements  to  be  obtained  from  these  specialized  sources 
for  the  design  evaluation  of  nonelectronic  designs.  Section  three 
provides  guidelines  for  developing  test  programs  for  nonelectronic 
equipment. 
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SECTION  1 

RELIABILITY  PROGRAM  PLANNING  AND  CONTROL 


1.1  INTRODUCTION 

Planning  and  control  of  a  reliability  program  Includes  the  selection 
of  reliability  tasks  to  be  conducted  during  a  development  program  and  the 
determination  of  methods  for  surveillance  and  control  to  assure  that 
reliability  requirements  are  being  met.  MIL-STD-785  Is  the  most  commonly 
used  guidance  document  to  establish  planning  and  control  requirements  for 
equipment  development  and  production  reliability  programs.  This  standard 
Includes  five  tasks  for  program  surveillance  and  control  which  are  to  be 
tailored  to  Individual  programs. 

e  Task  101,  Reliability  program  plan 
e  Task  102,  Monitor/Control  of  subcontractors  and  suppliers 
e  Task  103,  Program  reviews 

e  Task  104,  Failure  reporting,  analysis  and  corrective  action 
system 

•  Task  105,  Failure  review  board 

Tasks  102  through  105  are  designed  for  control  of  a  reliability  pro¬ 
gram  and  applied  In  a  similar  way  for  both  electronic  and  nonelectronic 
designs.  Conversely,  the  planning  of  a  reliability  program  will  require 
some  distinctions  to  be  made  for  nonelectronic  designs.  This  section 
describes  the  unique  characteristics  of  nonelectronic  designs  and  the 
special  considerations  to  be  Incorporated  in  the  program  planning  effort. 

A  reliability  plan  describes  the  efforts  to  be  performed  for 
evaluating  the  design,  t 'liability  controls  to  be  established  and  tests 
to  be  performed.  MIL-STD-785  emphasizes  the  selection  of  Independent 
program  elements  and  standardized  procedures  to  be  applied  In  the 
planning  of  reliability  programs.  For  example,  reliability  estimates  of 
electronic  equipment  during  conceptual  and  validation  phases  can  be 
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made  without  many  design  details  being  available  and  Independently  from 
other  analysis  and  testing  tasks.  These  preliminary  estimates  of 
reliability  can  be  generated  with  the  use  of  MIL-HOBK-21 7  and  expected  to 
be  sufficiently  precise  so  that  reliability  apportionment  can  be 
Initiated.  Also,  MIL-STD-781  has  been  prepared  for  electronic  equipment 
and  the  statistical  test  plans  contained  therein  can  be  used  to  select  an 
effective  and  efficient  testing  procedure  for  the  entire  equipment 
without  a  great  deal  of  dependency  on  the  results  of  reliability 
predictions,  Failure  Mode,  Effects  and  Criticality  Analysis  (FMECA)  or 
any  other  analysis  task. 

Nonelectronic  equipments  on  the  other  hand  often  consist  of 
one-of-a-kind  component  designs.  Consequently,  development  programs  for 
nonelectronic  designs  may  be  characterized  by  limited  experience  data  for 
reliability  analyses,  a  short  supply  of  equipment  samples  and/or  test 
time  for  reliability  testing,  and  a  need  to  rely  on  component  test 
results  for  analysis  data  and  demonstration  of  total  equipment 
reliability.  The  lack  of  performance  data  and  adequate  testing  time  Is 
caused  by  unique  characteristics  of  nonelectronic  equipment  and  will 
require  special  methods  for  reliability  program  planning.  The  unique 
characteristics  of  nonelectronic  equipment  and  their  effect  on  program 
planning  can  be  summarized  as  follows. 

e  Reliability  predictions  of  nonelectronic  designs  depend  to  a 
large  extent  on  Internally  generated  fatigue  and  component  life  test 
data.  This  closed  analysis/testing  loop  Is  caused  by  the  fact  that: 

(a)  nonelectronic  components  are  not  standardized  to  the  extent  that 
reliability  Information  from  previous  experience  with  similar  equipment 
can  be  directly  applied  to  a  new  design  at  higher  Indenture  levels,  (b) 
the  effects  of  derating  are  not  quantitatively  available  for 
nonelectronic  designs  in  predicting  reliability  and  (c)  published  failure 
rates  for  nonelectronic  components  do  not  contain  Information  on  material 
properties  or  operational  stresses  which  affect  times  to  failure  such  as 
fatigue  behavior,  axial  or  side  loading  history,  thermal  stress 
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cycles  or  physical  alignment  of  parts.  Therefore,  analysis  and  testing 
tasks  for  nonelectronic  development  programs  must  be  planned  so  that 
Internally  generated  test  data  can  be  used  to  the  extent  possible  for 
reliability  predictions.  If  external  sources  of  reliability  data  such  as 
the  Nonelectronic  Reliability  Notebook  or  the  Nonelectronic  Parts 
Reliability  Data  Publication  (NPRD-2)  are  used  for  reliability 
predictions  they  must  be  done  so  with  these  unique  characteristics 
considered. 

•  Operational  environment  and  utilization  rate  are  much  more 
critical  In  the  analysis  and  testing  of  nonelectronic  equipment  because 
of  direct  Interface  with  operator  and  environment.  Equipment  definitions 
In  the  analytical  process  must  be  very  precise  and  test  plans  for  non¬ 
electronic  equipment  must  reflect  this  sensitivity.  Human  factors  relia¬ 
bility  must  be  Included  as  part  of  the  nonelectronic  reliability  program 
to  describe  the  machine-operator  Interface. 

•  Individual  nonelectronic  components  such  as  power  transmission 
devices  and  clutch  assemblies  often  perform  more  than  one  function  and 
failure  data  for  a  specific  application  are  difficult  to  obtain.  Each 
function  must  be  individually  analyzed  to  predict  component  reliability. 
Test  time  requirements  can  also  be  Increased  because  of  the 
multi-functional  characteristics  of  a  particular  component.  The  addi¬ 
tional  time  requirements  to  analyze  and  test  each  component  function  must 
be  considered  in  the  planning  of  reliability  program  tasks. 

•  Definitions  of  failure  for  nonelectronic  designs  depend  upon 
equipment  application  causing  uncertainties  In  the  use  of  published 
failure  data.  Many  failure  modes  such  as  "loose"  hardware,  "noisy" 
bearing  or  "excessive"  wear  reflect  a  degraded  condition  of  the  component 
rather  than  a  catastrophic  failure.  A  definition  of  failure  for 
nonelectronic  equipment  must  specify  the  point  at  which  the  degraded 
component  must  be  repaired  or  replaced.  This  failure  definition  for  the 
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intended  component  application  will  aid  in  utilizing  published  failure 
data  for  reliability  predictions  and  establishing  accept/reject  criteria 
for  the  testing  program. 

•  Tlroe-to-f allure  of  a  particular  nonelectronic  component  may  be 
dependent  upon  material  wear  properties  not  described  by  a  constant 
failure  rate  distribution  and  the  test  plan  may  have  to  be  based  on 
procedures  other  than  those  contained  In  MIUSTD-781.  Internally 
generated  data  must  Include  times-to-fallure  of  Individual  components  In 
addition  to  total  system  operating  hours  and  total  failures. 

•  Reliability  qualification  testing  can  not  always  be  performed 
"In  accordance  with  MIl-ST0-781M  because  of  the  small  sample  sizes  avail¬ 
able  and  the  length  of  time  required  to  detect  deterioration  type  failure 
modes.  It  may  be  necessary  to  use  results  of  an  FMECA  to  maximize  use  of 
equipment  samples  and  available  test  time.  Accept/reject  criteria  must 
be  carefully  considered  in  the  reliability  program  planning  effort  to 
Include  the  effects  of  fatigue  and  other  stress  related  factors  and  the 
accelerated  testing  environment  or  loading  conditions.  Care  must  be 
exercised  in  evaluating  results  of  a  long  duration  test  to  distinguish 
failures  which  are  random  from  those  caused  by  a  wear  out  failure  mode. 

The  above  characteristics  of  nonelectronic  designs  necessitate  some 
unique  reliability  program  requirements  that  will  ensure  extensive 
coordination  of  analysis  and  testing  efforts  throughout  the  development 
program.  The  Interrelationships  of  analysis  and  testing  tasks  are  shown 
In  Figure  1-1,  Additional  front-end  planning  over  and  above  that 
required  by  MI L-STO-785  should  be  accomplished  prior  to  Issuance  of  a 
Request  For  Proposal  {RFP)  or  Initiation  of  reliability  tasks.  This 
section  describes  the  elements  of  a  nonelectronic  reliability  program 
which  must  be  considered  by  the  procuring  activity  prior  to  release  of  an 
RFP,  and  by  the  contractor  In  preparing  a  reliability  program  plan. 
Section  1.2  provides  recommendations  for  the  procuring  activity  to 
Include  In  the  RFP  considering  available  program  funding  and  time 


10 


FIGURE  11.  TYPICAL  ANALYSIS/TESTING  PROCESS  FOR  NONELECTRONIC  EQUIPMENT 


constraints.  Section  1.3  provides  procedural  methods  for  the  contractor 
who  Is  developing  a  reliability  program  plan  for  a  nonelectronic  design. 

1.2  RELIABILITY  PROGRAM  REQUIREMENTS  IN  THE  RFP 

The  reliability  analysis  of  nonelectronic  equipment  may  consist  of 
any  number  of  Individual  tasks  such  as  reliability  allocation, 
prediction,  FMECA,  Fault  Tree  or  Reliability  Centered  Maintenance 
analysis.  To  accomplish  any  of  these  tasks  the  equipment  must  first  be 
defined  In  terms  of  Its  operational  environment.  Next,  reliability 
models  or  block  diagrams  must  be  established  and,  finally,  quantitative 
values  of  reliability  must  be  determined  from  detailed  analysis/testing 
results.  A  reliability  program  for  nonelectronic  designs  will  Include 
the  accumulation  of  component  test  results  as  an  Input  to  the  analytical 
process.  Designing  a  reliability  demonstration  test  for  nonelectronic 
equipment  will  require  a  similar  analytical  process  of  defining,  the 
equipment  to  be  tested,  establishing  block  diagrams,  Identifying  failure 
modes  of  multi-functional  components  and  determining  which  component 
functions  require  life  tests  to  be  performed.  As  shown  In  Figure  1-1, 
Integration  of  analysis  and  testing  tasks  will  be  required  to 
successfully  plan  a  reliability  program.  The  planning  process  should  be 
Initiated  during  preparation  of  the  RFP. 

The  contractor  will  be  expected  to  generate  a  reliability  program 
plan  for  coordinating  reliability  tasks.  If  the  contractor  Is  to  estab¬ 
lish  a  meaningful  reliability  program  plan,  the  procuring  activity  must 
provide  certain  minimum  Information  in  the  RFP.  One  item  which  requires 
special  emphasis  for  the  development  of  a  nonelectronic  design  Is  a 
description  of  the  equipment  to  be  developed  In  Its  operational 
environment.  Another  Item  to  be  Included  In  the  RFP  for  nonelectronic 
designs  is  a  definition  of  reliability  tasks  to  be  performed  and  the 
purpose  of  each  task.  The  two  subsections  which  follow  provide  guidelines 
for  Including  these  items  in  the  RFP. 


1.2.1  Define  the  equipment  In  Its  operational  environment 

Obtaining  meaningful  results  from  reliability  tasks  requires 
contractor  understanding  of  the  environment  under  which  the  equipment  to 
be  developed  will  be  operated,  maintained,  transported  and  stored.  Com¬ 
ponent  parts  of  the  equipment  can  not  be  effectively  evaluated  or  failure 
rates  determined  without  a  knowledge  of  operational  environment.  This 
Information  must  be  supplied  by  the  procuring  activity  and  Is  particularly 
applicable  to  nonelectronic  equipment  because  of  the  direct  exposure  of 
nonelectronic  equipment  to  operator  handling  and  environmental  extremes. 

An  example  of  the  different  environment  that  exists  between  elec¬ 
tronic  and  nonelectronic  equipment  Is  the  modern  electrostatic  duplicating 
machine  where  the  electronic  components  are  Installed  on  printed  circuit 
cards  and  somewhat  protected  In  a  card  cage  from  direct  contact  by  the 
operator  or  the  elements.  On  the  other  hand,  nonelectronic  components 
such  as  sorting  mechanisms,  paper  loading  bins  and  front  panel  controls 
are  often  directly  exposed  to  the  operator  and  may  be  subject  to  detri¬ 
mental  handling  procedures.  Defining  the  operating  environment  Is 
probably  the  most  Important  and  difficult  task  In  preparing  an  RFP. 

Equipment  definition  Includes  design  requirements  and  operational 
characteristics,  such  as  Intended  use,  operational  procedures, 
environmental  envelope,  failure  definition  and  maintenance  philosophy. 
Nonelectronic  equipment  Is  usually  designed  for  more  than  a  single  mode 
of  operation  and  may  be  active  at  different  times  during  the  day  or 
mission.  Therefore,  functional  variations  and  equipment  requirements  for 
each  operational  mode  and  mission  phase  must  be  considered  In  preparation 
of  the  RFP.  It  Is  Imperative  that  the  procuring  activity  Include  all 
mission  environments  In  the  RFP  that  are  to  be  considered  by  the 
contractor  for  the  reliability  program.  The  contractor  will  further 
define  the  equipment  and  Its  requirements  In  the  reliability  program  plan 
by  breaking  the  system  down  Into  major  functional  parts,  displaying  these 
parts  as  functional  diagrams,  and  describing  the  function  of  each  part 
and  the  Interfaces  between  the  parts. 
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Fatigue  Is  one  of  the  key  factors  affecting  equipment  reliability. 

The  designer  realizes  that  a  provision  of  adequate  strength  Is  no  guaran¬ 
tee  that  equipment  subjected  to  varying  loads  will  meet  required  relia¬ 
bility.  The  procuring  activity  must  realize  that  the  soundness  of  a 
design  Is  no  better  than  the  soundness  of  fatigue  load  Information. 
Operational  scenarios  must  be  made  available  to  the  designer  so  that 
loading  actions  can  be  accurately  defined. 

Numerical  reliability  requirements  In  the  RFP  may  be  based  on  proba¬ 
bility  of  mission  success,  mean  time  to  failure  (MTTF),  mean  time  between 
failures  (MTBF),  life  expectancy  or  aqy  other  reliability  term  which 
specifies  equipment  reliability  requirements.  It  Is  Important  that  these 
requirements  be  based  on  Information  at  the  total  system  or  mission  level 
so  that  the  contractor  can  Identify  equipment  requirements  and  consider 
all  mission  factors  such  as  logistics,  operational  environment,  operator 
Interface  and  maintenance  In  the  reliability  program.  Simply  stating  an 
equipment  MTBF  In  the  RFP  without  tying  this  requirement  to  operational 
and  maintenance  profiles  does  not  answer  the  contractor's  need  to  design 
his  reliability  program  plan  around  total  mission  or  system  reliability 
requirements. 

The  amount  of  detail  required  to  define  the  equipment  In  the  RFP 
will  vary  to  a  considerable  extent  with  equipment  complexity  and  unique¬ 
ness  of  function.  The  basic  elements  of  an  equipment  definition  shown  In 
Table  1-1  must  be  considered  by  the  procuring  activity  In  preparing  an 
RFP.  Many  details  will  be  missing  In  the  RFP  and  the  equipment  definition 
will  require  refinement  and  updating  as  more  Information  becomes  available 
during  the  development  program. 


Each  of  the  components  listed  In  Table  1-1  must  be  Included  In  the 
RFP  so  the  contractor  can  establish  a  roadmap  for  conducting  reliability 
tasks  In  his  response  to  the  RFP.  Well  structured  requirements  In  the 
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RFP  will  avoid  delays  In  the  development  program  caused  by  misunderstand¬ 
ings  of  schedule,  budget,  available  resources  and  expected  results  of  the 
reliability  program. 


TABLE  1-1 

COMPONENTS  OF  AN  EQUIPMENT  DEFINITION 
TO  BE  INCLUDED  IN  THE  RFP 


Design  requirements 

Mission  or  operational  requirements 

Equipment  utilization  for  each  operating  cycle 

Maintenance  philosophy 

Environmental  profiles 

Failure  definitions 

Numerical  reliability  requirements 


1.2.2  Identify  reliability  tasks  to  be  performed  and  their  purpose 
The  second  element  to  be  Included  In  the  RFP  Is  a  listing  of  relia¬ 
bility  tasks  to  be  performed  and  an  Identification  of  their  Intended  use. 
It  Is  particularly  Important  for  nonelectronic  designs  that  the  contractor 
establish  the  Interrelationship  between  tasks  because  of  their  dependency 
upon  one  another  as  shown  in  Figure  1-1.  Most  tasks  In  MIL-STD-785  are 
applicable  to  both  electronic  and  nonelectronic  equipment.  Two  tasks 
which  require  some  special  considerations  In  the  RFP  for  nonelectronic 
designs  Include  reliability  analysis  and  reliability  testing.  The 
following  paragraphs  provide  guidelines  for  specifying  the  Intended  use 
of  analysis  and  testing  results  with  consideration  given  to  funding  and 
scheduling  constraints.  The  guidelines  will  be  separated  Into  two  parts: 


(a)  reliability  analysis  considerations  In  the  RFP,  and 

(b)  reliability  testing  considerations  In  the  RFP, 
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For  a  reliability  analysis  task  to  be  cost  effective  It  must  ful¬ 
fill  one  or  more  of  the  specific  objectives  listed  In  Table  1-2.  The 
procuring  activity  should  address  the  desired  utilization  of  analysis 
results  In  the  RFP. 


TABLE  1-2 

TYPICAL  OBJECTIVES  OF  AN  ANALYSIS  TASK 


Task  Objective 

Task 

Relative 

Cost 

e 

Allocate  subassembly  reliability 
requl rements 

Allocation 

Noderate 

e 

Rank  the  criticality  of  potential 
failure  modes 

Criticality 

analysis 

Expensive 

e 

Compare  alternate  designs  In  terms 
of  life  expectancy  or  reliability 

FNECA 

Noderate 

e 

Determine  the  effects  of  a  proposed 
design  change  on  equipment  perfor¬ 
mance 

FNECA 

Moderate 

e 

Serve  as  an  Input  for  design  reviews 

FNECA 

Noderate 

e 

Identify  high  failure  rate  Items 
for  spares  provisioning 

FNECA 

Expensive 

e 

Predict  the  frequency  of  maintenance 
actions  as  an  Input  to  maintain¬ 
ability  analysis 

FNECA 

Expensive 

e 

Predict  equipment  reliability  as  a 
starting  point  on  the  growth  curve 

Reliability 

prediction 

Expensive 

e 

Determine  contractual  compliance  with 
numerical  requirements 

Reliability 

prediction 

Expensive 
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Some  of  the  objectives  for  an  analysis  effort  listed  In  Table  1-2  are 
In  terms  of  a  relative  evaluation  of  reliability  while  others  require  a 
quantitative  assessment.  Comparing  designs,  allocating  spares  and  pro¬ 
jecting  the  number  of  failure  mode  occurrences  for  design  tradeoff 
decisions  all  depend  upon  an  estimate  of  reliability,  the  precision  of 
which  Is  not  the  most  Important  criteria,  but  rather  the  detection  of 
potential  design  related  problems.  Performing  a  reliability  prediction 
to  generate  a  number  does  not  usually  serve  ary  useful  purpose  unless  a 
high  degree  of  confidence  based  on  past  experience  with  similar  equipment 
or  published  failure  rate  data  can  be  demonstrated.  Applications  such  as 
estimating  contractual  compliance  to  reliability  requirements  or  determi¬ 
ning  If  reliability  goals  are  achievable  with  a  new  design  will  not 
generally  warrant  the  cost  of  the  exercise  for  nonelectronic  equipment 
because  the  prediction  will  not  be  sufficiently  accurate  for  engineering 
design  decisions.  In  summary,  merely  placing  a  requirement  In  the 
contract  to  perform  a  reliability  prediction  In  accordance  with  MIL-STD- 
756  seldom  results  In  a  meaningful  analytical  effort.  The  application  of 
a  reliability  prediction  should  be  well  defined  before  such  a  task  1$ 
placed  In  the  RFP. 

MIL- STD- 756  Is  commonly  referenced  In  an  RFP  for  the  performance  of 
reliability  predictions.  This  standard  provides  for  a  compilation  of 
component  failure  rates  from  a  handbook  or  other  source  of  failure  rate 
Information  In  order  to  predict  system  level  reliability.  The  approach 
works  well  for  electronic  equipment  where  component  standardization  has 
permitted  the  development  of  MIL-HDBK-217,  a  very  good  source  of  failure 
rate  data  for  electronic  components. 

Sources  of  failure  rate  data  for  nonelectronic  components  such  as  the 
Nonelectronic  Reliability  Notebook  are  excellent  for  a  feasibility  type 
prediction,  but  because  failure  rate  data  from  alternate  sources  reflect 
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such  a  wide  dispersion  of  operational  and  environmental  conditions  of 
use,  the  contractor  will  have  difficulty  In  performing  a  prediction  with 
sufficient  confidence  to  meet  all  of  the  typical  expectations  of  a  relia¬ 
bility  prediction  as  listed  In  Table  1-2.  When  compared  to  the  task  of 
predicting  electronic  equipment  reliability,  nonelectronic  equipment 
Involves  greater  difficulty  and  expense  due  to  specialized  designs,  non¬ 
standardization  of  components  and  the  need  to  perforin  a  more  detailed 
analysis  of  stress  levels. 

Recognizing  the  potential  lack  of  confidence  In  a  reliability 
rediction  for  nonelectronic  designs,  the  RFP  should  emphasize  the 
location  of  overstressed  components,  evaluation  of  alternative  designs 
and  reliability  growth.  The  tradeoff  between  cost  of  the  analysis  task 
and  potential  benefits  to  be  derived  must  be  evaluated  prior  to  Issuing 
the  RFP.  For  many  nonelectronic  designs  a  detailed  stress  analysis  will 
have  to  be  performed  for  the  reliability  prediction  to  be  sufficiently 
precise  to  meet  the  objectives  of  an  analysis  task  listed  In  Table  1-2. 
This  Is  an  expensive  procedure  if  performed  on  all  detail  parts.  A  more 
economical  approach  is  the  combined  FMECA/stress  analysis.  The  FMECA  Is 
a  very  powerful  tool  for  evaluating  nonelectronic  designs  through  the 
Identification  of  potential  failure  modes  and  their  effects  on  system 
performance.  The  FMECA  can  be  used  to  Identify  those  critical  areas 
where  a  stress  analysis  should  be  performed  and  eliminate  the  expense  of 
performing  a  stress  analysis  for  all  parts.  Section  2  of  this  volume 
describes  the  procedures  for  combined  analysis  tasks  when  applied  to 
nonelectronic  designs. 

The  criticality  analysis  is  part  of  the  FMECA  and  requires  a  determi¬ 
nation  of  the  frequency  of  occurrence  for  each  failure  mode.  This 
process  requires  many  of  the  same  methods  as  required  for  performing  a 


reliability  prediction.  As  stated  previously!  reliability  predictions 
for  nonelectronic  designs  require  a  stress  analysis  of  critical  failure 
modes  which  have  been  identified  by  the  FMECA.  Because  of  the 
interdependency  of  reliability  predictions  and  FMECAs.  a  rellabill 
rediction  should  not  be  Included  In  the  AFP 


without  a  FHgCA  requirement.  Therefore,  If  funding  or  time  constraints 
exist  a  FMECA  will  be  more  cost  effective  than  a  reliability  prediction 
toward  achieving  reliability  growth. 

If  both  a  reliability  prediction  and  a  FMECA  are  to  be  performed,  the 
combined  FMECA  and  reliability  prediction  effort  may  be  a  more  cost 
effective  Input  for  engineering  trade-off  decisions  and  project  control. 
The  FMECA  can  be  used  to  Identify  those  critical  areas  of  a  design  where 
a  stress  analysis  Is  required,  such  as  a  component  requiring  extended 
maintenance  tlm  ot  a  large  quantity  of  spare  parts  or  a  component  that 
Is  critical  to  on  success.  Non-crltlcal  areas  can  rely  on  other 
less  costly  prediction  methods  utilizing  data  from  similar  equipment 
comparisons,  NPRD-2  or  the  Nonelectronic  Reliability  Notebook.  The 
reliability  analysis  must,  however,  be  performed  with  emphasis  on  design 
evaluation  rather  than  an  exercise  to  generate  reliability  numbers.  In 
any  event,  the  procuring  activity  should  not  expect  a  great  deal  of 
precision  or  place  a  great  deal  of  confidence  In  reliability  prediction 
results  for  nonelectronic  equipment.  The  procuring  activity  must  formu¬ 
late  the  Intended  use  of  analysis  results  and  the  RFP  should  reflect  one 
or  more  of  the  objectives  listed  In  Table  1-2  so  the  contractor  can 
generate  a  roadmap  of  analysis  and  testing  tasks  accordingly. 

{ b)  Reliability  testing  considerations  In  the  RFP 

For  a  reliability  testing  program  to  be  cost  effective  It  must  ful¬ 
fill  one  or  more  of  the  specific  objectives  as  contained  In  Table  1-3, 
which  were  derived  from  MIL-STO-785. 
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TABLE  1-3 

TYPICAL  OBJECTIVES  OP  A  DEVELOPMENT 
TESTING  PROGRAM 


•  Disclose  deficiencies  In  tht  equipment  design, 
materials  and  workmanship 

e  Provide  measured  reliability  data  as  an  Input  to 
other  analysis  tasks 

e  Determine  compliance  with  quantitative  reliability 
requirements 

e  Determine  requirements  for  environmental  stress 
screening  (ESS)  tests 

e  Determine  requirements  for  the  production 
reliability  acceptance  test  (PRAT)  program 


Fulfillment  of  these  objectives  requires  some  specialized  test  plans 
for  nonelectronic  equipment.  The  procuring  activity  should  Include  the 
Intended  use  of  test  results  from  this  list  In  the  RFP  so  the  contractor 
can  formulate  his  test  plan  accordingly. 

The  contractor  Is  expected  In  his  test  plan  to  fully  describe  the 
test  methods  for  compliance  to  requirements.  The  accomplishment  of  tost 
program  objectives  requires  a  determination  as  to  the  extent  of  testing 
and  the  environment  under  which  the  tests  should  be  run.  Test  require¬ 
ments  are  not  well  defined  for  nonelectronic  equipment  In  any  published 
standard.  Significant  differences  must  be  considered  for  establishing 
test  requirements  In  an  RFP  for  electronic  versus  nonelectronic  equipment. 
For  example,  specifying  a  test  "In  accordance  with  MIL-STD-781"  may  not 
be  practical  because  of  limited  sample  sizes  and  testing  time. 


In  addition  to  outlining  objectives  of  the  testing  program,  the 
procuring  activity  must  Include  a  description  of  test  program  requirements 
In  the  RFP  as  listed  In  Table  1-4. 


TABLE  1-4 

REQUIREMENTS  FOR  A  TEST  PROGRAM 
TO  BE  INCLUDED  IN  THE  RFP 


(1) 

Tests  to  be  performed 

(2) 

Degree  of  test  realism 

(3) 

Definition  of  test  failure 

(4) 

Degree  of  confidence  for  the 

qualification  test  program 

The  following  paragraphs  provide  a  brief  summary  of  these  tost  program 
requirements  and  Section  3  contains  recommendations  for  developing  the 
test  plan. 

(1)  Tests  to  be  performed  -  Integrated  testing  programs  are 
designed  to  detect  potential  design  related  problems,  assure  system 
design  Integrity,  estimate  achievable  reliability  and  verify  that  a 
system  Is  ready  for  the  next  phase  of  development  or  for  production. 
Several  development  type  tests  to  achieve  these  goals  are  Included  In 
MIL-STD-785  and  are  listed  in  Table  1-5.  These  tests  as  applied  to 
nonelectronic  designs  are  described  in  Section  3. 
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TABLE  1-5 

DEVELOPMENT  TEST  PROCEDURES 
FOR  NONELECTRONIC  DES16NS 


o  Reliability  engineering  tests 

-  Reliability  development/growth  tests 

-  Environmental  stress  screening  (ESS) 
o  Reliability  accounting  tests 

-  Reliability  qualification  test 

-  Production  reliability  acceptance 

test  (PRAT) 


Reliability  engineering  tests  are  performed  to  determine  basic  design 
capabilities  and  functional  characteristics,  detect  failure  inodes,  and 
determine  wear  rates  and  other  time  dependant  failure  mechanisms  so  that 
design  Improvements  can  be  effected  and  the  life  expectancy  of  components 
verified.  ESS  or  run-in  testing  is  Intended  to  detect  manufacturing 
defects  by  stressing  the  equipment  under  test. 

Reliability  accountlng/quallflcatlon  tests  are  Intended  to  provide 
assurance  that  minimum  acceptable  reliability  requirements  are  being  met 
prior  to  starting  production  of  the  equipment,  qualification  tests  are 
formal  acceptance  tests,  performed  In  an  operationally  realistic  environ¬ 
ment  and  are  statistically  designed  to  provide  estimates  of  demonstrated 
reliability.  Ideally  these  are  formal  tests,  conducted  under  strict 
environmental  and  operational  profile  conditions,  with  maintenance 
performed  In  accordance  with  specified  access  for  repairs. 

(2)  Degree  of  test  realism  -  An  RFP  must  contain  requirements  which 
will  result  In  tests  as  realistic  as  possible  In  relation  to  actual 
operational  and  environmental  conditions.  This  Is  particularly  true  for 
nonelectronic  equipment  which  usually  Interfaces  with  the  operator  and 
environment  more  directly  than  does  electronic  equipment.  For  example. 
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many  switches  and  actuator  assemblies  come  In  direct  contact  with  an 
operator  whereas  electronic  components  mounted  on  a  printed  circuit  board 
are  somewhat  "protected"  from  an  operator  or  other  failure  Inducing 
environment.  The  more  realistic  the  test  In  terms  of  simulating 
operational  and  environmental  profiles  the  greater  the  chance  of 
detecting  design  deficiencies  and  defects  caused  by  manufacturing 
processes  that  otherwise  could  be  discovered  only  after  the  equipment  Is 
placed  Into  service.  Nonelectronic  equipment  Is  often  subjected  to 
direct  handling  by  the  operator  and  therefore  tests  must  be  more 
operationally  oriented  than  for  electronic  equipment.  The  large  physical 
size  of  many  nonelectronic  equipments  and  the  long  testing  time  required 
for  each  mode  of  operation  may  require  some  specially  prepared  procedures 
to  achieve  a  high  degree  of  test  realism.  The  RFP  should  require  the 
contractor  In  his  response  to  propose  the  operational  and  environmental 
profiles  to  be  simulated. 

(3)  Definition  of  test  failure  -  Just  as  Important  as  realism  In 
test  planning  Is  realism  In  defining  a  failure,  a  difficult  task  for 
nonelectronic  equipment  because  many  component  failures  are  subjective. 
Terms  such  as  "noisy",  "binding",  or  "leaking"  are  legitimate  failure 
modes  but  not  easily  quantified.  It  Is  Imperative  that  these  types  of 
failures  be  defined  In  the  equipment  specification  Included  with  the  RFP 
and  reflect  realistic  operational  environments. 

It  Is  customary  during  electronic  testing  procedures  to  operate  the 
equipment  until  a  failure  occurs,  shut  down  the  equipment  for  repairs  and 
then  operate  the  equipment  until  the  next  failure.  For  nonelectronic 
equipment  this  approach  may  not  be  practical  because  of  the  longer  test 
time  required  for  small  sample  sizes.  A  more  efficient  testing  operation 
Is  required  and  long  periods  of  shut  down  can  not  be  afforded.  Differ¬ 
ences  between  critical  and  minor  failures  must  be  defined  In  the  RFP  so 
that  the  test  need  not  be  stopped  for  minor  failures.  However,  the  test 
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will  have  to  be  Interrupted  briefly  at  predetermined  times  for 
measurements  of  wear,  critical  clearances  and  other  time-dependent 
parameters. 

(4)  Degree  of  confidence  for  the  qualification  test  program  -  Reli¬ 
ability  Is  a  time  and  stress  dependent  parameter  for  nonelectronic  equip¬ 
ment  as  shown  In  Figure  1-2  and  there  Is  no  way  to  verify  reliability 
without  extensive  test  data  and  sufficient  testing  time  to  establish  a 
confidence  factor.  The  problem  that  the  contractor  will  have  in  design¬ 
ing  qualification  tests  for  nonelectronic  equipment  Is  the  fact  that 
specialized  designs  In  small  quantities  limit  the  number  of  units 
available  for  test.  MI L' STD-781  contains  some  high  risk  test  plans  for 
small  sample  sizes  but  very  often  only  one  unit  Is  available  for  qualifi¬ 
cation  test.  For  nonelectronic  equipment,  test  data  must  be  accumulated 
from  piece  part  testing,  component  evaluation  tests  and  any  other 
available  source.  The  key  to  using  this  data  for  evaluating  reliability 
Is  the  maintenance  of  exact  records  on  bench  testing  and  prototype 
testing  In  the  very  early  design  stages  that  Includes  test  time  and 
operational  environment.  Some  of  the  failure  rate  data  for  Individual 
components  can  be  applied  toward  the  reliability  demonstration  test  If 
the  test  records  contain  not  only  accept/reject  data  but  also  time 
dependent  Information  such  as  mechanical  wear,  crack  size  and  fatigue 
data.  The  procuring  activity  must  identify  In  the  RFP  the  degree  of 
confidence  required  for  the  testing  program  and  the  type  of  tests 
required  for  reliability  demonstration  while  recognizing  the  potential 
restriction  of  test  time. 

1.2.3  Summary  of  RFP  requirements 

Section  1.2  provided  some  general  guidelines  for  Including  In  the  RFP 
the  necessary  reliability  requirements  for  nonelectronic  designs.  These 
guidelines  are  not  Intended  to  be  all  Inclusive  but  rather  present  special 
nonelectronic  design  considerations  f6r  tailoring  existing  reliability 
documents  and  achieving  a  cost  effective  reliability  program.  Require¬ 
ments  to  be  considered  In  preparing  an  RFP  for  nonelectronic  designs  are 
summarized  In  Table  1-6. 


TIME 

FIGURE  1-2.  EFFECT  OF  TIME  AND  STRESS  LEVELS  ON  FAILURE  RATE 
FOR  NONELECTRONIC  EQUIPMENT 

1.3  RELIABILITY  PROGRAM  PLAN 

Just  as  the  procuring  activity  must  establish  certain  minimum 
requirements  In  the  RFP  for  developing  a  reliability  program,  so  must  the 
contractor  establish  his  roadmap  for  conducting  reliability  tasks.  A 
reliability  program  plan  describes  the  coordinated  effort  of  all  relia¬ 
bility  tasks  to  be  accomplished  and  includes  the  methods  to  perform  the 
tasks  as  required  by  the  contract.  The  procuring  activity  In  reviewing 
the  program  plan  can  assure  that  cost  effective  plans  and  controls  are 
established  for  the  development  effort.  This  section  describes  the  unique 
aspects  of  the  reliability  program  as  it  applies  to  nonelectronic 
equipment. 

The  reliability  program  plan  generated  by  the  contractor  must  contain 
an  equipment  definition  and  a  procedure  for  each  reliability  task.  A 
listing  of  reliability  program  tasks  is  Included  In  MIL-STD-785  and  such 

25 


r  •  ;5A;.vv’- I  A: •  '■ ; 


TABLE  1-6 

SUMMARY  OF  RFP  REQUIREMENTS 
PARTICULAR  TO  NONELECTRONIC  DESIGNS 


a  Equipment  definitions  must  be  precise  to  the  extent 
possible  In  describing  multl-functlonel  operating 
environments,  failure  criteria  and  numerical  reliability 
requirements. 

a  An  evaluation  of  analysis  objectives  must  be  made  prior 
to  citing  compliance  to  reliability  specifications. 

e  Reliability  predictions  should  not  be  specified  without 

an  FMECA. 

e  Care  must  be  exercised  In  specifying  MIL-STD-781  for 
nonelectronic  equipment  because  the  qualification  test 
may  be  completed  prior  to  the  detection  of  time 
dependent  failure  mechanisms  and  therefore  provide  a 
false  Indication  of  reliability.  The  RFP  should  require 
the  contractor  to  establish  test  methods  In  the  program 
plan  which  will  establish  confidence  factors  through  the 
accumulation  of  testing  data  at  lower  equipment  levels. 

a  Test,  Analyze  And  Fix  (TAAF)  programs  are  designed  to 
achieve  operational  reliability  consistent  with 
contractual  requirements  through  failure  detection, 
failure  analysis  and  the  Incorporation  and  verification 
of  design  changes  to  prevent  recurrence  of  failure. 

TAAF  programs  should  be  emphasized  In  the  RFP. 
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documents  as  Data  Item  Description  DI-R-3533.  These  lists  should  be 
reviewed  for  each  program.  Planning  efforts  requiring  particular 
attention  for  nonelectronic  designs  are  Tinted  In  Table  1-7. 


TABLE  1-7 

PLANNING  EFFORTS  REQUIRING  PARTICULAR 
ATTENTION  FOR  NONELECTRONIC  DESIGNS 


•  Construction  of  roadmaps  for  reliability  tasks  to  be 
performed 

•  Description  of  how  each  reliability  task  will  be 
performed 

t  Identification  of  known  reliability  problems  to  be 
solved,  their  impact  and  proposed  solution 
a  Development  of  reliability  growth  procedures 
a  Development  of  reliability  qualification  procedures 


One  of  the  problems  the  contractor  encounters  In  establishing  a 
reliability  plan  for  a  particular  nonelectronic  development  program  Is 
the  determination  of  the  type  analyses  to  be  performed  for  a  given  phase. 
For  example,  a  contractual  requirement  to  perforin  an  FMECA  In  accordance 
with  MIL-STD-1629  does  not  necessarily  result  In  a  cost  effective  or  even 
useful  FMECA.  The  contractor  may  perform  a  top-down  functional  FMECA,  a 
bottom-up  hardware  FMECA  or  coitiul nation  thereof.  The  contractor  may 
perform  an  FMECA  with  a  qualitative  or  quantitative  criticality  analysis. 
Depending  on  the  analysis  objectives  as  described  in  the  RFP,  the 
contractor  structures  the  analysis  tasks  so  they  will  be  completed  at  a 
time  when  they  can  contribute  measurably  to  system  reliability. 

Sometimes  a  less  detailed  analysis  performed  early  In  the  development 
phase  will  be  more  cost  effective  than  a  more  detailed  analysis  completed 
too  late  to  affect  design  Improvements. 


Analysis  tasks  and  testing  programs  must  be  tailored  to  the  non¬ 
electronic  equipment  being  developed,  the  development  phase  and  purpose 
of  the  analysis.  The  contractor  must  know  why  each  task  requirement  Is 
contained  in  the  RFP,  The  contractor  must  then  propose  In  his  program 
plan  which  methods  will  be  used  to  meet  these  objectives.  After  reviewing 
equipment  definitions,  reliability  tasks  to  be  performed  and  the  purpose 
of  each  task,  tho  contractor  must  establish  ground  rules  and  assumptions 
for  performing  the  tasks.  Each  ground  rule  as  shown  In  Table  1-8 
requires  special  considerations  for  a  nonelectronic  design. 


TABLE  1-8 

GROUND  RULES  TO  BE  ESTABLISHED  IN  A 
RELIABILITY  PROGRAM  PLAN 


(1)  Equipment  levels  for  analysis  and  testing 

(2)  Environmental  and  operational  requirements 
to  be  considered 

(3)  Failure  definitions 

(4)  Criticality  analysis 

(5)  Threshold  levels  of  criticality 

(6)  Determination  of  data  sources 

(7)  Derating  criteria  to  be  used 


(1)  Equipment  levels  for  analysis  and  testing  -  Establishing  a 
ground  rule  for  the  equipment  levels  of  the  analysis  Is  dependent  upon 
the  desired  use  of  analysis  results,  availability  of  design  Information 
and  program  contralnts  of  cost  and  calendar  time.  The  following  guide¬ 
lines  can  be  used  to  select  the  equipment  levels  between  which  the 
analysis  will  be  performed: 


a.  The  lowest  equipment  level  at  which  the  analysis  Is  effective 
is  that  level  for  which  Information  Is  available  to  establish 
definition  and  description  of  functions.  The  lowest  equipment 
level  Is  Influenced  by  previous  experience.  The  greater  the 
level  of  detail  and  number  of  failure  possibilities  considered, 
the  greater  will  be  the  cost  and  the  time  required  for  the 
analysis.  Less  analysis  detail  can  be  justified  for  Items 
having  a  good  reliability,  maintainability  and  safety  record. 
Conversely,  greater  detail  and  a  corresponding  lower  equipment 
level  is  Indicated  for  items  having  a  questionable  reliability 
history  for  an  unproven  design  or  when  the  equipment  Is  critical 
to  mission  success. 

b.  The  specified  or  Intended  maintenance  and  repair  level  may  be  a 
valuable  guide  In  determining  the  lowest  equipment  level  for 
the  analysis.  Results  of  the  maintenance  analysis  will 
determine  the  lowest  level  at  which  maintenance  will  be 
performed  and  the  lowest  level  of  analysis  Is  often  defined  as 
the  equipment  level  Immediately  below  this  lowest  level  of 
maintenance.  For  example,  the  lowest  replaceable  assembly  In  a 
hydraulic  system  may  be  a  valve  assembly.  The  reliability 
analysis  should  therefore  Include  the  failure  modes  of  0-rlngs, 
packings  and  other  parts  of  the  valve.  This  analytical  process 
will  assure  the  consideration  of  all  contributing  failure  modes 
to  each  replaceable  item.  On  critical  Items  the  analysis  may 
be  performed  down  to  lower  part  levels  to  determine  failure 
causes  such  as  wear  rate,  contaminants  and  corrosion. 

c.  Results  of  the  analysis  to  select  the  Initial  equipment  level 
are  used  to  determine  the  requirements  for  the  next  and  subse¬ 
quent  levels.  Both  the  critical  functional  elements  for  which 
a  detailed  stress  analysis  Is  required  and  the  non-crltlcal 
functional  elements  that  do  not  require  further  analysis  are 
Identified. 


d.  During  the  conceptual  phase,  the  top-down  functional  approach 
as  described  In  MIL-STD-1629  or  ARP  926  Is  effective  In  elimi¬ 
nating  Inadequacies  of  the  design  concept.  In  the  validation 
phase,  the  more  detailed  bottom-up  hardware  approach  may  be 
more  appropriate  to  Identify  critical  failure  modes. 

(2)  Environmental  and  operational  requirements  -  Another  ground 
rule  to  be  established  Is  the  limit  of  acceptable  performance  and  the 
environmental  and  operating  conditions  to  be  considered  during  the 
analysis.  Assumptions  should  be  made  with  respect  to  alternate  modes  of 
operation.  Block  diagrams  serve  os  a  point  of  reference  throughout  the 
analysis  and  the  environmental  and  operational  conditions  assumed  for  the 
analysis  should  be  listed  on  the  appropriate  block  diagrams. 

(3)  Failure  definitions  -  The  next  ground  rule  to  be  established 
Includes  general  statements  of  what  constitutes  a  failure  of  the  equip¬ 
ment  In  terms  of  performance  parameters  and  allowable  limits  for  each 
specified  output.  These  statements  are  amplified  from  those  provided  In 
the  RFP  and  are  established  at  progressively  lower  equipment  levels. 
Excessive  friction  noise  or  leakage  rate  are  examples  of  failures  which 
must  be  defined  In  quantitative  terms. 

(4)  Criticality  analysis  -  A  ground  rule  Is  required  to  establish 
the  method  of  criticality  evaluation  best  suited  for  the  analysis  being 
undertal.  The  practical  levels  of  quantification  for  the  expected 
failure  rate  and  severity  level  are  determined.  ARP  926  and  MIL-STD-1629 
contain  criticality  analysis  procedures. 

(5)  Threshold  levels  of  criticality  -  Depending  on  the  purpose 

of  the  analysis,  specific  Investigations  are  performed  above  a  predeter¬ 
mined  threshold  for  severity  level  and  failure  rate.  For  example,  a 
maintenance  oriented  analysis  will  require  an  Investigation  of  all  fail¬ 
ure  modes  having  a  high  projected  rate  of  occurrence  regardless  of  the 
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associated  severity  level.  Conversely ,  a  safety  or  mission  success 
oriented  analysis  will  require  an  Investigation  of  all  failure  modes 
having  a  high  severity  level  regardless  of  the  projected  failure  rate. 

This  ground  rule  establishes  the  threshold  levels  for  severity  end 
failure  rate  above  which  specific  Investigation  will  be  performed. 

(6)  Determination  of  date  sources  -  The  next  step  In  performing 
a  reliability  analysis  Is  the  determination  of  data  sources.  Failure 
rate  data  sources  must  be  reviewed  In  order  to  determine  the  acceptability 
of  the  data  base  In  relation  to  the  utilization  of  analysis  results  and 
the  accuracy  requirements  of  the  analysis.  The  contractor  has  several 
choices  In  selecting  a  source  of  failure  rate  data  as  shown  in  Table 
1-9.  In  utilizing  test  data,  for  example.  It  can  not  always  be 
ascertained  whether  test  data  from  an  actuator  Is  derived  from  Impulse 
tests  or  cycling  tests;  yet,  failure  rates  from  the  two  tests  could  be 
significantly  different.  Another  reason  that  failure  rates  listed  In  one 
source  often  vary  considerably  from  those  In  another  Is  because  some  data 
sources  provide  replacement  rates  rather  than  actual  failure  rates. 

Various  failure  rate  tables  have  been  derived  with  different  degrees  of 
precision,  different  operating  environments  and  component  utilization. 

Not  all  data  bases  Include  manufacturing  techniques,  quality  control 
procedures  or  the  time  on  the  market  of  new  components.  Careful 
screening  of  available  sources  will  provide  optimum  accuracy  of  analysis 
results. 

Levels  of  precision  for  failure  rates  of  electronic  components 
published  In  MIL-HDBK-217  are  relatively  high  and  reliability  estimates 
for  electronic  equipment  can,  as  a  result,  be  fairly  accurate.  Evaluating 
the  reliability  of  nonelectronic  equipment,  however,  Is  usually  much  more 
Involved  than  for  electronic  equipment  because  the  failure  rate  of  a 
nonelectronic  part  Is  more  dependent  upon  design  configuration,  equipment 
age,  operational  environment  and  application. 


TABLE  1 *9 

TYPICAL  SOURCES  OF  FAILURE  RATE  DATA 


•  Internal  data  bait  at  established  from  similar 
equipment  operating  In  a  similar  environment  and 
similar  operating  conditions 

e  A  set  of  prediction  equations  developed  from  finite 
element  analysis  or  stress  analysis  results 

e  Engineering  estimates  at  a  very  low  equipment  level 

e  Published  failure  rate  data 


In  addition,  nonelectronic  parts  are  usually  not  standardized  because  of 
the  need  for  a  unique  design  to  perform  a  multitude  of  functions.  The 
first  step  In  selecting  a  data  source  Is  the  review  of  the  analysis  method 
or  methods  to  be  utilized,  the  Intended  use  of  the  analysis  and  the 
resulting  degree  of  accuracy  required.  The  second  task  In  selecting  the 
data  source  Is  an  analysis  of  available  data.  Several  sources  of  failure 
rate  data  are  available  such  as  the  Nonelectronic  Reliability  Notebook 
and  NPRD-2 .  Many  commercial  firms  maintain  their  own  data  base  and  many 
laboratories  maintain  data  on  particular  parts.  Table  1-10  Includes  the 
factors  Involved  In  selecting  a  data  base. 

If  the  contractor  has  no  data  base  available  to  him  that  appears  to 
be  applicable  to  his  design,  his  own  analytical  approach  may  be  better 
than  utilizing  published  data.  However,  a  failure  rate  based  on  "engi¬ 
neering  Judgement"  Is  not  adequate.  Some  rationale  for  a  derived  failure 
rate  must  be  provided  by  the  contractor.  For  example,  historical  failure 
rate  data  from  testing  a  similar  design  can  be  multiplied  by  a  "K" 
correction  factor  to  reflect  the  use  of  new  materials.  Although  the  "K" 
factor  Is  still  an  engineering  estimate  It  Is  based  on  strength  of 


TABLE  MO 

CONSIDERATIONS  FOR  SELECTING  A  SOURCE 
OF  FAILURE  RATE  DATA 


•  Availability  of  failure  rate  references  (lab  test 
data,  field  data,  vendor  data,  similar  parts, 
handbooks,  etc.) 

e  The  "acceptability11  of  the  data  base  In  terms  of 
previous  utilization  and  experience  with  the  data 

e  Differences  between  failure  definition  used  In  the 
analysis  and  that  obtained  from  data  sources 

e  Type  of  equipment  for  whlrh  comparison  Is  to  be  made 
and  application  (airborne,  shipboard,  etc.) 


materials,  new  lubricants  or  other  design  Improvements  which  can  later  be 
validated.  Other  guidelines  for  using  available  failure  rate  data  are  as 
follows: 

e  Avoid  using  MTBF  figures  that  were  collected  from  data  where  few 
failures  occurred  during  short  term  tests  of  a  relatively  large 
number  of  test  Items. 

e  Use  caution  when  applying  the  exponential  reliability  function 
to  a  model  for  a  specific  time  period.  Failures  may  not  be 
caused  by  random  high  stress  levels  but  rather  due  to  component 
deterioration  with  respect  to  time. 
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(7)  Derating  criteria  to  be  used  -  Derating  Is  defined  In 
MIL-STD-721  as  (1)  "the  us*  of  an  Item  In  such  a  way  that  applied 
stresses  are  below  rated  values"  or  (2)  "the  lowering  of  the  rating  of  an 
Item  In  one  stress  flel^  to  allow  an  Increase  In  rating  In  another  stress 
field".  MIL-HD8K-217  Is  a  data  base  of  failure  rates  as  a  function  of 
stress  loads  for  electronic  components  which  permits  a  trade-off 
determination  between  failure  rate  and  stress  level.  Derating  can  be 
confirmed  by  stress  analysis  and  the  effects  of  more  or  less  derating  can 
be  predicted  In  trade-off  decisions.  For  example,  designers  can  derate 
capacitors  In  terms  of  voltage  or  a  transistor  can  be  derated  In  terms  of 
junction  temperature.  In  each  case  a  failure  rate  for  the  selected 
derating  factor  can  be  derived  from  MIL-HDBK-217.  Derating  Information 
contained  In  this  Handbook  Is  based  on  extensive  failure  rate  data  where 
stress  levels  could  be  determined. 

Nonelectronic  components  can  not  be  derated  so  easily  as  voltage  or 
junction  temperature  and  some  alternate  procedures  must  be  considered. 
First  of  all,  each  nonelectronic  component  quite  often  reflects  an  Indi¬ 
vidual  design  and  derating  procedures  must  be  tailored  to  that  design. 
Secondly,  a  nonelectronic  component  will  often  be  sensitive  to  more  than 
one  stress  level  and  a  review  of  derating  procedures  must  be  made  from  an 
operational  and  environmental  system  level  perspective.  A  mechanical 
actuating  arm  for  example  Is  derated  In  terms  of  safety  factor  depending 
on  a  detailed  analysis  of  material  strengths,  stress  raisers,  and  mechan¬ 
ical  stresses  on  the  actuating  arm.  In  addition  to  external  conditions 
such  as  shock  and  vibration,  design  parameters  affecting  reliability 
Include  rotation  rate  and  the  resulting  shock  pulse  at  the  end  of 
actuator  travel, 

The  design  process  Involves  the  application  of  derating  procedures 
to  prevent  failure  and  at  the  same  time  meet  size  and  weight  restric¬ 
tions,  and  the  designer  1$  constantly  confronted  with  decisions  as  to 
what  safety  factors  to  use  for  a  design.  For  nonelectronic  equipment  the 


derating  exercise  Is  usually  more  affectively  accomplished  through  the 
designer's  experience  rather  than  any  rigid  mathematical  or  design 
evaluation  process.  The  margin  between  operating  stress  levels  and 
material  strengths  are  estimated  with  consideration  given  to  material 
properties  and  loading  configuration.  A  typical  derating  procedure  Is 
conducted  as  shown  In  Table  1-11. 

TABLE  1-11 

TYPICAL  DERATING  PROCEDURE 


0)  Design  and  configuration  specifications  are  examined 
and  those  failure  modes  which  are  sensitive  to  the 
design  are  determined 

(2)  Material  properties  that  are  directly  related  to  these 
failure  inodes  are  determined  with  consideration  given 
to  material  cost  and  availability 

(3)  Strength  data  for  selected  materials  are  obtained  from 
literature  or  results  of  lab  tests 

(4)  Stress  levels  are  determined  from  environmental  and 
operational  profiles 

(5)  Stress/strength  relationships  are  evaluated  In  terms  of 
design  constraints 


The  design  review  process  outlined  In  Table  1-11  Is  enhanced  by 
experience.  The  assessment  of  assumptions  used  In  the  stress  analysis 
associated  with  design  derating  as  well  as  the  ability  to  anticipate 
which  failure  modes  govern  the  design  Is  presently  not  based  on  any 
standardized  procedure  but  rather  experience  with  the  particular 
equipment  Involved.  Handbooks  are  not  generally  available  that  provide 
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derating  factors  of  nonelectronic  components.  Finite  element  techniques, 
NASTRAN  and  various  computer  programs  are  available  to  designers  for 
structural  type  analyses  and  the  reliability  engineer  must  work  with  the 
stress  analyst  In  deriving  derating  factors  and  equating  these  factors 
Into  a  projected  failure  rate. 

For  nonelectronic  equipment,  derating  procedures  are  often  the  main 
factor  affecting  reliability.  Failures  are  often  Introduced  by  wear  out 
mechanisms  which  In  turn  are  related  to  loading.  An  evaluation  of 
loading  characteristics  as  well  as  stress  Is  an  essential  element  in  any 
derating  procedure.  Because  the  Identification  and  application  of 
derating  procedures  are  performed  more  on  the  basis  of  experience  rather 
than  methodology,  It  seems  Impractical  fo Y  a  reliability  analyst  to  get 
Involved  to  the  extent  necessary  to  affect  design  Improvements.  The 
reliability  analyst's  contribution  should  be  In  the  area  of  providing 
operational  and  environmental  Information  to  the  stress  analyst,  identi¬ 
fying  failure  modes  and  assisting  to  equate  stress  analysis  results  to 
failure  rates. 

1.3.1  Summary  of  reliability  program  planning  requirements 

Section  1.3  provides  general  guidelines  for  Including  the 
necessary  elements  for  nonelectronic  designs  In  the  reliability  program 
plan.  These  guidelines  are  not  Intended  to  be  all  Inclusive  but  rather 
to  present  those  special  requirements  for  nonelectronic  designs  so 
existing  reliability  documents  can  be  tailored  for  a  cost  effective  reli¬ 
ability  program.  Figure  1-3  provides  a  typical  list  of  tasks  to  be 
considered  In  formulating  a  reliability  program  plan.  The  conclusion  to 
be  reached  from  the  Interrelationship  of  tasks  Involved  In  a  nonelec¬ 
tronic  reliability  program  Is  that  both  the  procuring  activity  and  the 
contractor  must  recognize  the  need  to  coordinate  analysis  and  testing 
tasks  for  nonelectronic  designs. 
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FIGURE  13.  TYPICAL  REQUIREMENTS  OF  A  RELIABILITY  PRl 


SECTION  2 

DESIGN  AND  EVALUATION 


2.1  INTRODUCTION 

Reliability  analyses  are  performed  during  the  conceptual,  validation 
and  engineering  development  phases  of  design  to  (a),  Identify  potential 
problem  areas  for  design  review  consideration  and  (b).  provide  an 
Indication  of  the  degree  of  success  that  a  completed  equipment  Is 
expected  to  have  under  established  conditions  of  operational  use. 
handling  and  maintenance.  Standard  procedures  are  available  for  some 
analysis  tasks  such  as  MIL-STD-756  In  conjunction  with  M1L-HDBK-217  for 
reliability  predictions  and  MIL-STD-1629  or  ARP  926  for  the  FMECA. 
Procedures  contained  In  these  documents  must  be  tailored  to  the 
Individual  analysis  task.  Possible  tasks  as  referenced  In  MIL-STD-785 
are  listed  In  Table  2-1.  Application  of  those  tasks  requires  extensive 
tailoring  for  nonelectronic  designs. 


TABLE  2-1 

TYPICAL  DESIGN  AND  EVALUATION  TASKS 


e  Task  201,  Reliability  modeling 

e  Task  202,  Reliability  allocations 

e  Task  203,  Reliability  predictions 

e  Task  204,  Failure  modes,  effects,  and  criticality 

analysis 

e  Task  205,  Sneak  circuit  analysis 
e  Task  206,  Electronic  parts/circuits  tolerance 
analysis 

e  Task  207,  Parts  program 

e  Task  208,  Reliability  critical  Items 

e  Task  209,  Effects  of  functional  testing,  storage, 
handling,  packaging,  transportation,  and  maintenance 


Section  1  of  this  volume  provides  some  guidelines  for  selecting  the 
most  appropriate  analysis  tasks  for  a  new  procurement  or  development 
effort.  Regardless  of  the  analysis  tasks  selected  or  Imposed  In  the 
contract,  certain  basic  procedures  will  apply  as  listed  In  Table  2-2. 


TABLE  2-2 

BASIC  PROCEDURE  FOR  A  RELIABILITY  ANALYSIS 


#  Equipment  definition 

e  Reliability  models 

e  Identification  of  failure  modes 
e  Detailed  reliability  analysts 

e  Failure  mode  crltlcallty/rellablllty  prediction 

e  Analysis  summary 


The  tasks  Included  In  this  section  are  Intended  to  provide  guidance 
for  selecting  the  most  appropriate  method  of  analysis  for  the  development 
program.  Recommended  tasks  conform  to  MIL-STD-756,  MIL-HDBK-217, 
MIL-STD-1629,  ARP  926,  and  other  procedural  standards  which  may  have  been 
prepared  primarily  for  the  analysis  of  electronic  equipment.  The  tasks 
are  not  Intended  to  replace  the  requirements  of  standard  procedures  but 
should  be  tailored  according  to  the  reliability  program  plan  and  used  In 
conjunction  with  and  to  support  standard  reliability  procedures.  Tasks 
Included  In  this  volume  emphasize  the  distinguishing  characteristics  of 
performing  an  analysis  of  a  nonelectronic  design  In  relation  to  standard 
procedures.  MIL-STD-756,  MIL-STD-1629  and  the  other  standards  should  be 
used  for  the  actual  analysis. 

2.2  EQUIPMENT  DEFINITION 

The  first  step  In  conducting  a  reliability  analysis  Is  to  define 
the  equipment  and  equipment  levels  to  be  analyzed.  Fulfilling  the  purpose 
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of  and  obtaining  meaningful  results  from  a  reliability  analysis  depends 
upon  a  complete  definition  of  the  equipment  to  be  analyzed. 


Equipment  definition  Includes  design  requirements  and  operational 
characteristics  such  as  Intended  equipment  use,  operational  procedures, 
environmental  envelope,  failure  definition  and  maintenance  philosophy. 
Defining  the  equipment  and  Its  requirements  Is  accomplished  by  breaking 
the  system  down  Into  major  functional  parts,  displaying  these  parts  on 
block  diagrams,  and  describing  the  function  of  each  part  and  the 
Interfaces  between  parts.  Nonelectronic  equipment  Is  usually  designed 
for  more  than  a  single  mode  of  operation  and  may  be  active  at  different 
times  during  the  day  or  mission.  Therefore,  functional  variations  and 
equipment  requirements  for  each  operational  mode  and  mission  phase  must 
be  considered.  It  Is  Imperative  that  the  contractor  Include  all  mission 
environments  In  his  equipment  description. 

Nonelectronic  equipment  often  Interfaces  with  the  operator  and 
environment  more  directly  than  does  electronic  equipment  and  defining 
this  Interface  Is  very  Important  to  the  effectiveness  of  reliability 
analysis  tasks.  Component  parts  of  the  equipment  can  not  be  effectively 
evaluated  or  failure  rates  determined  without  a  knowledge  of  their  opera¬ 
tional  environment.  This  part  of  the  equipment  definition  Is  critical 
for  nonelectronic  equipment.  Electronic  components  art  commonly  mounted 
on  printed  circuit  boards  within  a  card  cage  or  are  otherwise  protected 
from  external  handling  by  the  operator  and  direct  contact  with  the 
elements.  Nonelectronic  components  on  the  other  hand  often  Interface 
with  the  operator  or  outside  environment.  Defining  an  operating 
environment  Is  probably  the  most  Important  and  difficult  task  of  any 
analytical  effort. 

The  amount  of  detail  required  to  define  the  equipment  will  vary  to 
a  considerable  extent  with  equipment  complexity  and  uniqueness  of  func¬ 
tions.  Table  1-1  listed  the  components  of  an  equipment  definition  to  be 
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Included  In  the  RFP.  Many  details  of  the  equlpmont  definition  will  be 
missing  In  the  RFP  and  early  development  phase,  and  refinement  and 
updating  by  the  contractor  will  be  required  as  more  Information  becomes 
available. 

Within  the  RFP  the  procuring  activity  has  required  the  contractor 
to  discuss  some  of  these  elements  of  equipment  definition.  The  contractor 
In  his  response  to  tf*e  RFP  Includes  his  understanding  of  the  requirement 
In  greater  detail.  Further  refinement  of  definition  Is  required  for  the 
reliability  program  plan  and  each  design  and  evaluation  task.  Some  of 
the  more  Important  considerations  are  as  follows. 

(1)  Design  Requirements  -  One  aspect  of  design  requirements  for 
the  equipment  to  be  analyzed  Includes  a  physical  description  of  the 
equipment  Including  Its  configuration  and  specific  descriptions  which 
define  the  physical  composition.  Also  Included  In  design  requirements 
are  the  specifications  for  the  equipment  including  Its  purpose, 
operational  requirements  and  maintenance  philosophy.  Operational 
requirements  Include  stand-by  operation,  normal  operating  characteristics 
of  the  equipment  and  operating  life  requirements  In  cycles  or  time. 
Although  detailed  and  approved  specifications  will  not  normally  be 
available  In  the  early  development  phases,  preliminary  operational 
environment  and  maintenance  parameters  must  be  estimated.  They  can  be 
revised  later  as  approved  specifications  become  available. 

(2)  Equipment  utilization  for  each  operating  cycle  -  The  Intended 
utilization  of  the  equipment,  expected  number  of  total  operating  hours  or 
cycles  In  each  mode  of  operation  and  the  percent  of  total  operating  hours 
or  cycles  for  each  mode  must  be  estimated.  Each  phase  of  operation  It 
divided  Into  time  segments  such  as  start  up,  Idle,  etc.  If  the 
operational  mode  Is  expected  to  change  with  time,  such  changes  and  their 
expected  duration  are  defined. 


During  certain  operations  of  the  equipment  a  situation  may  arise 
that  subjects  the  Item  to  unique  environments  or  loading  conditions. 

These  conditions  are  described  for  each  mode  of  operation.  During  many 
operational  modes,  there  Is  human  contact  with  the  equipment.  Type  of 
contact  and  potential  handling  are  defined  for  the  physical  operation. 
Duration  of  the  Interaction  Is  estimated  and  unique  situations  caused  by 
unusual  Induced  environments  combined  with  human  contact  are  defined. 

(3)  Operational  parameters  and  environmental  profiles  -  Tempera¬ 
ture.  pressure,  humidity  and  climate  are  considered  for  each  phase  of 
operation,  Variations  In  natural  environments  for  various  segments  are 
defined  by  amplitude  and  duration.  For  example,  the  ambient  temperature 
surrounding  a  solenoid  actuator  assembly  may  have  a  projected  maximum  of 
85°C  for  five  hours  each  24  hour  day  and  20°C  for  12  hours  with  the 
expected  rate  of  change  being  20°C  per  hour,  Induced  environmental 
factors  such  as  velocity,  acceleration,  shock  and  vibration  which  may 
affect  operation  or  accelerate  degradation  of  the  equipment  Item  are  then 
Identified.  A  review  Is  made  to  determine  the  effects  of  equipment 
operation  In  both  the  nonoperatlonal  mode  and  the  operational  mode  on  the 
external  environment.  The  result  of  this  particular  task  defines  exhaust 
gases,  sparks,  noise  and  other  by-products  which  may  have  an  effect  on 
the  local  environment. 

(4)  Failure  Definitions  -  Conditions  which  constitute  a  failure 

of  the  equipment,  considering  maintenance  strategies,  spares  concept  and 
le.el  of  repair  are  described  as  part  of  the  equipment  Item  definition. 
For  nonelectronic  equipment  such  failure  modes  as  friction  noise, 
leakage,  and  roughness  must  be  defined. 

2.3  RELIABILITY  MODELS 

The  second  step  of  a  reliability  analysis  Is  the  development  of 
reliability  models  which  define  the  operations  necessary  for  determining 
equipment  or  mission  success.  Block  diagrams  can  be  used  to  depict 


functional  relationships  of  subsystems  and  components,  Identify  failure 
effects  on  Interrelated  components,  and  apportion  numerical  estimates  of 
equipment  reliability.  They  also  facilitate  the  reliability  analysis  by 
serving  as  a  reference  point  In  tracking  the  effects  of  a  particular 
failure  throughout  the  analysis.  Together  with  duty  cycle'  and  mission 
duration  Information,  the  block  diagram  Is  used  to  develop  mathematical 
expressions  or  computer  programs  which,  with  appropriate  failure  rate  and 
probability  of  success  data,  can  provide  assessments  of  reliability.  An 
example  of  a  functional  block  diagram  Is  shown  In  Figure  2-1.  Additional 
examples  are  Included  In  MIL-STD-1629  and  ARP  926. 


FIGURE  2-1.  EXAMPLE  OF  A  FUNCTIONAL  BLOCK  DIAGRAM  FOR  AIR 
CONDITIONING  SYSTEM 
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Block  diagrams  can  be  produced  only  after  a  thorough  system  defini¬ 
tion  Is  achieved  so  characteristics  and  functions  of  the  parts  can  be 
considered  In  performing  the  detailed  analysis.  However,  block  dia¬ 
grams  should  be  developed  as  soon  as  the  program  definition  permits  even 
though  numerical  data  are  not  yet  available. 

Development  of  logic  diagrams,  examples  of  which  are  shown  in 
Figure  2-2,  may  be  more  cost  effective  than  functional  block  diagrams  for 
complex  nonelectronic  equipment.  The  simulation  diagram  Is  essentially  a 
switching  network,  a  closed  contact  representing  equipment  success  and  an 
open  contact  representing  equipment  failure.  Each  complete  path  of 
contacts  represents  an  alternate  mode  of  operation  and  each  equipment 
Item  that  Is  required  for  operation  Is  Identified  by  a  contact  along  the 
path.  All  paths  terminate  at  a  single  point  (success).  This  approach  Is 
particularly  useful  for  nonelectronic  designs  which  often  carry  out  more 
than  one  function  for  different  operating  modes. 

The  logic  diagram  approach  lends  Itself  to  computer  simulation  for 
derivation  of  system  reliability.  The  basic  concept  of  the  simulation 
approach  Is  to  reproduce  equipment  operation  In  a  computer  and  then 
"operate"  the  equipment  through  Increments  of  time.  As  operation  contin¬ 
ues,  occurrence  of  failures  Is  simulated  by  the  generation  of  random 
numbers.  Operation  continues  until  total  equipment  failure  occurs  or 
until  the  mission  Is  completed.  A  large  number  of  equipment  operations 
are  simulated  and  reliability  Is  equal  to  the  percentage  of  successful 
missions.  MIl-STO-756  contains  a  more  complete  description  of  logic 
diagrams. 

A  nonelectronic  design  may  not  conform  to  the  constant  failure  rate 
assumption  Inherent  In  the  use  of  exponential  prediction  models  and  a 
specific  reliability  model  may  be  required  to  Incorporate  the  Increasing 
failure  rate  In  relation  to  time.  Distribution  laws  for  Individual  parts 
which  exhibit  an  Increasing  failure  rate  (aging)  are  determined  so  that 
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FIGURE  2-2.  EXAMPLES  OF  LOGIC  DIAGRAM8 
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failure  rates  or  probabilities  of  occurrence  needed  for  other  block 
diagrams,  logic  diagrams  or  other  reliability  models  can  be  computed. 
Time  dependent  models,  an  example  of  which  Is  shown  In  Figure  2-3,  are 
developed  by  Inserting  part  failure  rate  values  Into  the  model  In  the 
usual  manner  and  applying  the  appropriate  correction  factors  periodi¬ 
cally  In  order  to  obtain  predictions  for  the  component  as  It  accumulates 
operating  time. 


RESERVOIR 
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FIGURE  2  3.  EXAMPLE  OF  A  TIME  DEPENDENT  MODEL 


The  preceding  paragraphs  describe  several  approaches  to  diagraming 
nonelectronic  equipment  reliability.  Other  approaches  to  generating  block 
diagrams  or  models  can  of  course  be  established  by  the  contractor  and 
should  be  fully  described  In  his  reliability  program  plan.  Upon  complete 
evaluation  of  Individual  nonelectronic  components,  a  reliability  olock 
diagram  for  the  total  system  can  be  compiled.  Examples  of  reliability 
block  diagrams  are  contained  In  MIL-STD-756. 
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There  are  no  concrete  rules  for  the  development  of  a  particular 
reliability  model  at  a  given  design  phase,  For  example,  much  of  the 
design  Information  needed  to  develop  a  functional  block  diagram  Is  not 
available  during  the  preliminary  design  phase.  The  establishment  of 
overall  mission  success  diagrams  developed  from  similar  equipment  already 
In  existence  Is  often  a  better  approach  to  use  at  this  stage  of  develop¬ 
ment.  When  complicated  redundancies  or  maintenance  considerations  are 
Involved,  logic  diagrams  which  can  be  developed  for  computer  simulation 
of  equipment  performance  may  be  the  more  cost  effective  approach. 

2.4  IDENTIFICATION  OF  FAILURE  NODES 

The  next  basic  step  In  the  reliability  analysis  of  nonelectronic 
equipment  Is  the  Identification  of  failure  modes.  If  a  reliability 
prediction  or  allocation  Is  desired,  It  Is  advantageous  to  first  Identify 
all  failure  modes  for  the  nonelectronic  design.  Stress  analysis  can  then 
be  performed  on  those  failure  modes  determined  to  be  "critical". 
Procedures  are  presented  In  NIL-STD-1629  and  ARP  926  for  determining  the 
criticality  of  failure  modes.  Basically,  the  criticality  evaluation  of  a 
failure  mode  Includes  the  following  considerations: 

e  Failure  mode  resulting  In  loss  of  operational  capability 
e  Failure  mode  resulting  In  expensive  maintenance  action 
e  Safety  related  failure  mode 

e  High  frequency  of  occurrence  of  a  particular  failure  mode 

Initially  a  top-down  approach  as  defined  In  MIL-STD-1629  and  ARP  926 
Is  used  to  Identify  critical  failure  modes  at  the  system  level  and  to 
Identify  those  assemblies  which  require  a  detailed  stress  analysis  to  be 
performed.  This  process  Is  critical  to  nonelectronic  equipment  because 
It  Is  Impractical  to  perform  a  stress  analysis  on  all  parts. 
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2.5  DETAILED  RELIABILITY  AMALYSIS 

A  detailed  stress  analysis  Is  performed  on  critical  failure  modes.  A 
procedural  outline  for  determining  the  rate  of  occurrence  for  critical 
failure  modes  Is  shown  In  Table  2-3. 


TABLE  2-3 

STEPS  TO  DETERMINE  THE  RATE  OF  OCCURRENCE  OF 
CRITICAL  FAILURE  MODES 


(1)  Identify  critical  failure  inodes  of  each  listed 
equipment  Item 

(2)  Determine  failure  criteria 

(3)  Develop  evaluation  criteria 

(4)  Determine  material  properties  and  actual  design 

strengths 

(5)  Determine  actual  stress  levels  for  critical  failure 
modes 

(6)  Determine  degradation  properties 

(7)  Determine  failure  mode  probabilities 


(1)  Identify  critical  failure  modes  of  each  listed  equipment  Item  - 
The  first  step  in  performing  a  detailed  analysis  Is  to  determine  the  most 
critical  components  of  the  equipment  and  those  failure  modes  or  failure 
mechanisms  which  are  critical  to  reliability  or  operational  safety. 
Failure  modes  may  be  Identified  from  a  previously  performed  FMECA. 
Identification  of  critical  failure  modes  depends  on  the  design  approach 
such  as  a  safe-life  or  a  fall-safe  design  and  the  resulting  materials  and 
processes  selected.  Failure  modes  should  be  Identified  In  terms  of 
degradation  when  applicable. 
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which,  if  exceeded,  will  cause  equipment  performance  to  be  degraded  below 
a  specified  level.  Failure  definitions  arc  prepared  In  terms  of  perform¬ 
ance  parameters  and  allowable  limits  of  the  Item. 

(3)  Develop  evaluation  criteria  -  Evaluation  criteria  for  the 
equipment  being  analyzed  need  to  be  developed  unless  adequate  failure 
rate  data  are  available  for  manufacturing,  operational  and  environmental 
conditions.  The  time  period  for  evaluating  equipment  reliability  Is 
Identified  for  those  cases  In  which  a  constant  failure  rate  can  not  be 
assumed.  The  following  considerations  are  examples  of  evaluation 
criteria; 

e  X-ray,  borescope,  eddy  current,  ultrasonic  and  other  non-deatruc 
tlve  testing  methods  may  be  used  to  detect  cracks  and  other 
detrimental  flaws  In  structural  equipment.  Minimum  detectable 
flaw  size  and  the  probability  of  locating  such  cracks  based  upon 
the  method  and  frequency  of  Inspection  must  be  considered. 

e  Manufacturing  operations  which  will  be  required  during  the 
production  phase  and  residual  stresses  In  an  Item  as  a  result  of 
the  various  manufacturing  operations  are  considered  In  the 
degradation  analysis. 

e  Failure  effects  from  combined  loading  must  be  considered. 

e  Adequacy  of  the  criteria  Includes  the  degree  of  error  from 
assumptions  made  In  developing  the  criteria. 

e  The  effect  of  cumulative  damage  from  degradation  failures  which 
go  undetected  without  Inspection. 


The  mechanical  fatigue  and  fracture  properties  of  the  materials  used  In 
each  part  should  be  determined.  These  properties  Include  yield  strength, 
ductility  and  toughness.  Axial  bending  and  torsion  loading,  surface 
finishing,  stress  concentration,  fatigue  strength,  tensile  strength,  heat 
treatment,  temperature  and  other  modifying  factors  which  affect  strength 
of  the  Item  under  analysis  should  be  determined.  Unit  strength  means  and 
distributions  are  estimated  from  these  considerations.  Part  strengths 
with  appropriate  statistical  distributions  are  derived  and  expressed  as  a 
probability  of  failure.  If  distributions  can  not  be  derived,  part 
strengths  are  expressed  as  the  maximum  stress  which  can  be  sustained  for 
a  specified  number  of  cycles  or  hours  without  failure.  MIL-HDBK-5  and 
various  other  design  handbooks  provide  data  on  strength  of  materials. 

(5)  Determine  actual  stress  levels  for  critical  failure  modes  - 
Those  loads  and  loading  conditions  expected  to  be  encountered  during 
normal  operations  and  the  repetition  of  such  loads  and  factors  affecting 
the  stress  distribution  for  the  useful  equipment  lifetime  need  to  be 
determined.  Those  loads  which  may  result  from  either  natural  or  Induced 
environments,  and  which  most  contribute  to  wear  out  or  catastrophic 
failure  are  considered.  Natural  envl ronmental  loads  are  the  result  of 
extremes  In  temperature,  radiation,  salt  spray  and  other  adverse 
environmental  conditions,  Induced  environments  are  those  which  result 
from  operation  or  handling  of  the  Item  including  vibration,  shock, 
acceleration  and  other  adverse  conditions. 

(6)  Determine  degradation  properties  -  The  statistical  data  or 
maximum  stress  for  material  properties  may  be  modified  In  accordance  with 
expected  degradation.  The  Interaction  of  different  operational  environ¬ 
ments  such  as  the  accelerating  effects  of  salt  and  humidity  on  stress 
corrosion  are  considered  In  the  determination  of  degradation  properties. 


(7)  Determine  failure  mode  probabilities  -  An  evaluation  of  the 
stress/strength  processes  are  made  for  each  part  analyzed.  This  eva1ua> 
tlon  may  be  entirely  deterministic,  entirely  probabilistic,  or  a  combine- 
tlon  of  the  two  depending  on  the  criticality  of  evaluation  results.  This 
evaluation  yields  a  quantitative  estimate  of  failure  rate  for  each 
failure  mode.  The  bibliography  contains  some  excellent  sources  of 
Information  on  probabilistic  design  techniques. 

Reliability  data  required  to  determine  failure  mode  probabilities 
are  not  generally  available  from  published  handbooks.  Reliability  data 
for  nonelectronic  equipment  must  usually  be  derived  from  one  or  more  of 
the  following  sources: 

e  Engineering  stress  analysis 
e  Published  data  on  specific  types  of  detail  parts 
e  Test  programs  for  specific  parts  and  assemblies 
e  Tests  conducted  during  previous  development  programs  at  the 
component  and  part  level 

Most  of  these  sources  of  data  are  Internally  generated  within  the 
development  program  and  are  dependent  to  a  large  extent  upon  test  programs 
for  individual  components  and  parts  specifically  designed  to  provide 
failure  rate  data. 

2.6  FAILURE  MODE  CRITICALITY 

If  a  criticality  analysis  Is  to  be  performed,  the  rate  of  occurrence 
of  each  identified  failure  mode  Is  derived.  Values  of  severity  level  and 
failure  rate  are  used  to  Insert  failure  mode  Identification  numbers  Into 
a  matrix  Indicating  the  distribution  of  failure  mode  criticality.  MIL- 
STD-1629  and  ARP  926  both  contain  procedures  for  conducting  a  criticality 
analysis.  Several  additional  factors  should  be  considered  In  determining 
the  criticality  of  a  nonelectronic  design  as  follows: 


52 


a  Principal  failure  mechanism  -  Those  loads  resulting  from 
both  natural  and  Induced  environments  and  which  most  contribute  to  wear 
out  or  catastrophic  failure. 

e  Fundamental  effect  of  failure  mechanism  -  The  effect  of 
the  failure  mechanism  on  operation  or  function  of  the  part  under 
consideration  Including  secondary  effects.  Where  possible,  effects  are 
listed  as  a  gross  failure  such  as  fracture,  fatigue,  deformation  or 
Instability. 

•  Failure  distribution  -  An  engineering  judgement  as  to  the 
nature  of  the  failure  distribution  of  each  failure  mechanism.  Appropriate 
consideration  of  early  mortality  and  mechanical  wear  In  and  wear  out  Is 
addressed. 

e  Operational  dependency  -  The  critical  elements  of 
equipment  dynamic  operation  which  affect  failure  mechanisms  such  as  RPM, 
compressive  or  tensile  stress. 

e  Environmental  dependency  -  The  critical  elements  of  the 
environmental  envelope  for  the  equipment  which  affect  failure  mechanisms 
of  the  failure  modes  such  as  high  temperature  or  humidity. 

a  Production  or  life  cycle  dependency  -  The  equipment  time 
phase  such  as  process,  fabrication,  design,  storage,  handling  or  opera¬ 
tion  which  Is  most  critical  to  the  Item  quality  and  reliability. 

a  Loading  factors  -  An  analysis  of  loading  factors  on  the 
part  In  relation  to  the  principal  failure  mechanism. 

•  Margins  of  safety  -  Margin  of  safety  or  reliability  margin 
between  stress  and  strength  for  the  principal  modes  of  failure  for  each 
Item.  Safety  factors  can  be  obtained  from  design  handbooks,  detailed 
part  analysis,  actual  measurement  or  mechanical /structural  test  data. 


•  Analysis  life  cycle  -  The  time  phase  of  the  equipment  life 
If  the  principal  failure  mechanism  Is  assumed  to  be  subject  to  wear  out. 

•  Time  between  wear  out  events  -  The  estimated  time  between 
component  replacement  In  terms  of  cycles,  Impact  or  whatever  describes 
the  life  characteristics. 

•  Failure  detection  method  -  The  method  of  detection  If 
component  replacement  Is  dependent  upon  preventive  maintenance. 

•  Probability  of  failure  detection  -  The  probability  of 
detecting  the  degraded  equipment  If  replacement  Is  dependent  upon 
preventive  maintenance  or  Inspection. 

•  Component  life  rating  -  The  projected  component  life  as 
listed  In  manufacturing  catalogs  combined  with  engineering  judgement, 
Intended  condition  of  use  and  experience  with  similar  equipment. 

2.7  RELIABILITY  PREDICTION 

If  a  reliability  prediction  Is  to  be  performed,  one  or  more  proced¬ 
ural  methods  will  be  Involved.  During  the  concept  formulation  phase  when 
detailed  design  Information  Is  not  yet  available,  the  analysis  Is  usually 
limited  to  a  comparison  with  existing  equipment  having  functional  and 
operational  requirements  similar  to  those  of  the  equipment  being 
developed.  The  equipment  similarity  method  of  analysis  compares  the 
reliability  of  a  mature  system  design  with  what  may  be  expected  In  a  new 
but  similar  system  design.  The  reliability  of  the  mature  system  Is 
determined  usually  by  field  evaluations.  This  method  of  analysis  Is  often 
used  during  the  conceptual  phase  of  design  development.  As  more  detailed 
part  Information  becomes  available,  a  parts  listing  Is  obtained  and  a 
stress  analysis  of  critical  parts  Is  performed  to  keep  the  analysis 
current.  It  becomes  essential  In  performing  a  reliability  prediction  to 
first  perform  some  of  the  elements  of  an  FMECA.  Reliability  data  for 
nonelectronic  designs  Is  usually  not  available  from  universal  data  banks 


and  a  stress  analysis  on  critical  failure  modes  as  Identified  by  the  FMECA 
win  be  required. 

Two  prediction  methods  are  recommended  as  basic  to  a  reliability 
prediction  of  nonelectronic  designs. 

(a)  Stress  analysis 

(b)  Equipment  similarity 

Although  the  parts  count  prediction  method  utilized  for  electronic  designs 
can  be  used  for  a  feasibility  study  of  a  nonelectronic  design,  It  Is 
Impractical  to  refine  or  update  such  a  prediction  during  the  later  stages 
of  design  development.  The  parts  count  technique  without  a  stress  analy¬ 
sis  Is  therefore  not  recommended  for  nonelectronic  designs. 

(a)  Stress  analysis 

The  stress  analysis  procedure  for  predicting  reliability  Is  often 
used  for  the  final  reliability  prediction  when  detailed  design 
Information  and  the  operational  scenarios  are  available.  A  stress 
analysis  Is  performed  for  each  part  or  group  of  parts  and  the  predicted 
failure  rates  are  combined  according  to  the  reliability  model  to  produce 
a  total  equipment  failure  rate.  An  Initial  analysis  Is  made  to  assure 
that  the  occurrence  of  a  failure  Is  Independent  of  another  and  that 
failure  rates  do  not  vary  with  time.  A  time  dependent  analysis  may  have 
to  be  made  In  some  cases.  The  preliminary  analysis  also  assures  that 
failure  distributions  for  Individual  assemblies  not  exhibiting  a  constant 
failure  rate  will  have  little  or  no  effect  If  the  constant  failure  rate 
distribution  Is  assumed. 

Determining  stress  Involves  an  analysis  of  the  actual  loads  to 
which  the  nonelectronic  part  will  be  subjected.  A  load  Is  a  function  of 
factors  external  to  the  part,  the  factors  being  determined  by  functional 
requirements  of  the  entire  equipment.  After  the  loads  which  will  exist 
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on  the  part  are  evaluated,  the  adequacy  of  the  part  to  withstand  these 
loads  without  failure  Is  determined. 


The  method  of  determining  actual  loads  for  a  given  part  depends 
upon  the  model  selected.  The  preferred  technique  recognizes  that  loads 
or  stresses  acting  upon  nonelectronic  parts  are  not  assigned  specific 
values  but  have  ranges  of  values  with  a  probability  of  occurrence 
associated  with  each  variable.  To  utilize  the  procedure,  knowledge  of 
the  appropriate  statistical  stress  distribution  Is  required. 

It  is  evident  that  a  stress  analysis  Is  a  necessary  task  to  support 
a  reliability  prediction  of  a  nonelectronic  design.  The  stress  analysis, 
however,  depends  to  a  large  extent  on  Inputs  from  an  FMECA  to  determine 
the  critical  failure  modes  to  be  analyzed  since  It  may  be  uneconomical  to 
perform  a  stress  analysis  on  each  nonelectronic  part.  This  Interdepen¬ 
dency  creates  a  bond  that  connects  the  FMECA,  reliability  prediction  and 
stress  analysis.  Stress  analysis  results  are  usually  obtained  from  the 
design  group  and  equated  Into  failure  rates  for  the  reliability 
prediction  jointly  by  the  designer  and  reliability  analyst.  The 
relationship  of  a  stress  derating  number  or  safety  factor  to  failure  rate 
can  be  estimated  by  comparison  to  field  results  of  similar  designs  or  lab 
test  data. 

(b)  Equipment  similarity 

The  equipment  similarity  method  of  analysis  compares  the  reliability 
of  a  mature  system  design  with  what  may  be  expected  In  a  new  but  similar 
system  design.  The  reliability  of  the  mature  system  Is  usually  determined 
by  field  evaluations.  This  method  Is  often  the  only  analysis  that  can  be 
applied  during  the  early  phase  of  design  development  or  feasibility 
determination  but  Is  applicable  to  any  phase.  The  accuracy  of  the  analy¬ 
sis  depends  upon  the  availability  of  part  selection  and  derating  policies 
and  thermal  and  mechanical  environments.  The  greater  the  design  similar¬ 
ity  and  the  better  the  failure  documentation  on  the  mature  system  design, 
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the  better  the  basis  of  comparison  and  consequently  the  accuracy  of  the 
reliability  prediction  of  the  new  system  design. 

2.8  ANALYSIS  SUMMARY 

For  the  reliability  analysis  to  contribute  to  the  development 
process,  conclusions  which  strongly  lead  to  design  Improvements  or  further 
testing  must  be  clearly  documented.  These  Inputs  to  the  total  reliability 
program  are  very  Important  for  nonelectronic  designs  to  provide  probabi¬ 
lities  of  occurrence  of  critical  failure  modes  and  to  predict  total 
equipment  reliability.  Any  shortage  of  failure  rate  data  as  pinpointed 
In  the  summary  will  trigger  additional  testing  requirements  for  specific 
components.  Components  critical  to  system  or  mission  reliability  are 
also  Identified  In  the  analysis  summary  with  a  discussion  of  the 
Interaction  between  the  factors  which  contribute  to  potential  malfunction 
or  accelerated  wear  out. 


SECTION  3 


RELIABILITY  DEVELOPMENT  TESTING 


3.1  INTRODUCTION 

Integrated  testing  programs  are  designed  to  detect  design  related 
problems,  assure  system  design  Integrity,  estimate  achievable  reliability, 
determine  contractual  compliance  with  reliability  specifications  and 
verify  that  a  system  is  ready  for  the  next  phase  of  development  or  for 
production.  Results  of  a  testing  program  should  provide  reasonable 
assurance  that  equipment  specification  requirements  can  be  fulfilled  for 
Identified  operational  environments.  MIL-STD-785  provides  some 
objectives  of  a  development  test  program  which  were  summarized  In 
Table  1-3.  The  Standard  emphasizes  the  Importance  of  an  Integrated 
testing  program  combining  performance,  reliability  and  environmental 
stress  testing  to  the  extent  possible. 

To  accomplish  the  test  program  objectives  listed  In  Table  1-3,  each 
development  program  requires  a  determination  of  the  extent  and  environment 
of  the  tests  to  be  run.  These  requirements  are  not  well  defined  for 
nonelectronic  equipment  In  any  published  standard  and  usable  reliability 
data  from  which  to  derive  test  requirements  on  an  Individual  basis  Is 
limited.  There  are  several  differences  between  electronic  and 
nonelectronic  equipment  to  be  considered  In  establishing  test  programs 
and  guidelines  for  developing  test  programs  for  nonelectronic  equipment 
are  contained  In  the  following  sections.  Tests  are  divided  Into 
Reliability  Engineering  Tests  and  Reliability  Accounting  Tests. 

3.2  RELIABILITY  ENGINEERING  TESTS 

Kzllablllty  engineering  tests  are  performed  as  part  of  the  design 
effort  on  prototype  and  advanced  development  equipments  and  Individual 
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components  to  verify  basic  design  capabilities  and  functional  character¬ 
istics.  Tests  are  designed  to  detect  failure  modes  which  may  have  been 
overlooked  In  the  analysis  effort  and  provide  reliability  data  for  the 
revision  of  reliability  predictions.  As  discussed  In  Section  2,  the 
reliability  analysis  of  nonelectronic  equipment  Is  usually  based  upon  the 
Identification  of  failure  modes  and  an  estimate  of  the  frequency  of 
occurrence  for  each  failure  mode.  For  reliability  engineering  test 
results  of  nonelectronic  equipment  to  be  usable  for  analysis  efforts, 
good  record  keeping  Is  Imperative,  it  being  necessary  to  record  such 
things  as  materials  used,  clearances  and  surface  finish.  Also,  as 
established  In  Section  1,  the  test  program  will  to  a  large  extent  depend 
on  analysis  results  to  Identify  particularly  sensitive  components  which 
need  to  be  tested  for  specific  functional  reliability  Information.  The 
Interrelationship  of  reliability  engineering  tests  and  the  analysis 
effort  Is  shown  In  Figure  3-1. 

Reliability  engineering  tests  consist  of  two  types  of  tests  as 
described  In  MIL-STD-785. 

(a)  Reliability  development/growth  tests 

(b)  Environmental  stress  screening 

(a)  Reliability  development/arowth  tests 

Reliability  development/growth  tests  are  used  to  enhance  system 
reliability  through  Identification,  analysis  and  correction  of  failures, 
the  objective  being  to  optimize  reliability  prior  to  production. 

Development  tests  are  performed  during  the  conceptual  and  validation 
phases  of  design  without  accept/reject  criteria  and  are  Intended  to  verify 
the  design  approach,  Identify  potential  failure  modes,  determine  the 
effects  of  varying  stress  levels  and  environments  on  reliability,  and 
provide  data  for  analysis  tasks.  Tests  are  specifically  designed  to 
detect  wear  out  failure  modes,  measure  wear  and  determine  component 
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FIGURE  3-1.  TYPICAL  FLOW  DIAGRAM  OF  ANALYSfS/TESTING  PROCESS 
FOR  NONELECTRONIC  EQUIPMENT 


life.  Therefore,  development  tests  ere  usually  performed  at  component  or 
subassembly  levels.  Each  test  unit  should  be  scheduled  for  as  many  tests 
as  are  possible  In  order  to  secure  a  maximum  of  test  experience  and  data 
from  available  units.  The  following  examples  are  tests  which  may 
Introduce  new  failure  modes  to  be  considered  In  design  as  well  as 
generating  test  data. 

TEST  TEST  MONITORING 

Duty  Cycle  Wear,  fatigue.  Stability 

Humidity  Freeze-up,  Corrosion,  Contaminants 

Temperature  Binding 

Vibration  Fatigue,  Alignment,  Clearances 

Durability  Degraded  Performance 

Test,  Analyze  And  Fix  (TAAF)  programs  are  designed  to  achieve 
operational  reliability  consistent  with  contractual  requirements  through 
failure  detection,  failure  analysis  and  the  Incorporation  and  verification 
of  design  changes  to  prevent  recurrence  of  failures.  The  contractor 
should  design  his  testing  program  for  nonelectronic  equipment  around  this 
growth  process  because  qualification  testing  In  accordance  with  the 
procedures  of  MIL-STD-781  Is  often  Impractical  and  dependency  must  be 
placed  on  the  TAAF  program  to  provide  a  qualitative  assurance  that  relia¬ 
bility  objectives  are  being  met. 

TAAF  programs  for  nonelectronic  designs  must  have  two  objectives. 
First,  the  tests  must  be  designed  to  Identify  failure  modes  so  that 
effective  design  changes  may  be  Incorporated.  This  Is  the  primary  objec¬ 
tive  of  any  TAAF  program  but,  for  nonelectronic  equipment,  another  test 
objective  must  be  considered:  an  Indication  of  wear  out  failure  modes 
and  limited  component  life.  Tests  for  wear  out  are  destructive  In  nature 
and  these  tests  must  usually  be  accomplished  at  lower  Indenture  levels 
where  equipment  Is  more  available  and  less  costly. 


Data  requirements  for  a  quantitative  Indication  of  reliability 
necessitate  TAAF  programs  to  Include  assembly  level  as  well  as  system 
level  tests.  Reliability  data  must  be  obtained  from  whatever  sources  are 
available  because  of  the  shortage  of  available  equipment  for  official 
test  programs.  MIL-STD-785  combines  the  requirements  for  development 
tests  and  TAAF  programs.  For  nonelectronic  equipment  the  requirements 
for  test  planning  and  data  recording  of  development  tests  and  TAAF  pro¬ 
grams  are  more  distinct  than  for  electronic  equipment.  Degradation  type 
failure  modes  must  be  detected  early  In  the  development  program  and  tests 
to  detect  these  failure  modes  mutt  be  performed  at  the  lower  equipment 
levels. 

Reliability  davelopment  tests  are  usually  performed  on  parts,  com¬ 
ponents  and  lower  equipment  levels  to  determine  failure  modes  and  such 
variables  as  life  expectancy,  wear  rates  of  sliding  and  Impacting  parts 
and  other  time  dependent  failure  mechanisms.  TAAF  programs  on  the  other 
hand  are  performed  at  higher  equipment  levels  to  determine  potential 
reliability. 

It  Is  customary  during  the  TAAF  program  to  operate  the  equipment 
until  a  failure  occurs,  shut  down  the  equipment  for  repairs  and  then 
operate  the  equipment  until  the  next  failure.  For  nonelectronic  equipment 
this  approach  may  not  be  practical  since  the  tost  time  required  for  a 
small  sample  size  Is  too  long  and  nonessentlal  Interruptions  can  not  be 
afforded.  Specialized  test  plans  must  be  developed  for  nonelectronic 
equipment.  First,  differences  between  critical  and  minor  failures  must 
bo  determined  prior  to  Initiating  the  test  program  so  that  the  test  need 
not  be  stopped  for  minor  failures.  Second,  although  the  test  must  be 
Interrupted  at  predetermined  times  to  measure  such  parameters  as  wear 
rate,  critical  clearances  and  other  time-dependent  parameters,  such 
Interruptions  must  be  minimized. 
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The  purpose  of  a  TAAF  program  Is  not  only  to  obtain  a  measure  of 
reliability  but  also  to  achieve  reliability  growth  by  testing,  detecting 
design  change  requirements,  and  following  up  on  corrective  action  to 
verify  reliability  growth.  Only  minor  significance  can  be  placed  on  the 
statistics  of  TAAF  programs  for  nonelectronic  designs.  The  cost  benefit 
of  testing  programs  designed  to  provide  a  quantitative  value  of 
reliability  for  nonelectronic  equipment  Is  questionable.  Of  greater  cost 
effectiveness  may  be  the  process  of  detecting  potential  design  problems 
and  achieving  the  planned  reliability  growth,  a  determination  of 
reliability  being  accomplished  through  a  compilation  of  test  results  at 
lower  equipment  levels,  past  performance  data  with  similar  equipment, 
stress  analysis  results  and  other  reliability  data. 

(b)  Environmental  stress  screening 

Reliability  engineering  tests  specified  by  MIL-STD-785  to  be 
conducted  during  the  development  phase  Include  development  tests  and 
those  tests  as  part  of  the  TAAF  program.  Engineering  tests  are  designed 
to  detect  failure  modes  and  determine  wear  rates  and  other  time  dependent 
failure  mechanisms  so  that  design  Improvements  can  be  effected  and  the 
life  expectancy  of  components  extended.  Another  task  specified  during 
the  development  phase  by  MtL-STD-788  Is  the  Environmental  Stress 
Screening  (ESS)  test.  ESS  or  run-in  testing  Is  Intended  to  stimulate 
relevant  failures  by  stressing  the  equipment  under  test.  MIL-a7D-785 
provides  a  procedure  as  shown  In  Table  3-1  for  establishing  an  ESS  test 
plan. 


MIL-STD-785  also  specifies  that  the  results  of  ESS  testing  during 
development  shall  be  analyzed  and  used  as  the  basis  for  the  ESS  procedures 
to  bo  specified  for  production.  Prior  to  Incorporating  ESS  requirements 
Into  the  development  program  for  nonelectronic  equipment  the  total  quan¬ 
tity  of  equipments  to  be  fabricated  during  the  development  program  must 
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TABLE  3-1 

DEVELOPMENT  OF  ENVIRONMENTAL 
STRESS  SCREENING  TESTS 


(1)  Description  of  environmental  stress  types*  levels* 
profiles*  and  exposure  times  to  be  applied 

(2)  Identification  of  level  (part,  subassembly, 
assembly)  at  which  testing  will  be  accomplished 

(3)  Identification  of  Item  performance  and  stress 
parameters  to  be  monitored  during  ESS 

(4)  Proposed  test  duration  (failure  free)  Interval  and 
maximum  ESS  test  time  per  Item 


be  considered.  If  the  quantity  Is  on  the  order  of  several  equipments  or 
less,  such  a  requirement  may  not  be  practical.  ESS  procedures  for  the 
production  program  should  be  prepared  by  the  contractor  during  the  devel¬ 
opment  phase  but  these  procedures  may  have  to  be  prepared  from  development 
test  results  at  a  lower  equipment  level  or  from  the  TAAF  program  rather 
than  from  ESS  development  tests,  The  contractor  must  specify  In  his 
reliability  program  plan  how  F.SS  procedures  for  the  production  phase  are 
to  be  developed. 

3.3  RELIABILITY  ACCOUNTING  TESTS 

A  reliability  qualification  test  Is  one  accounting  type  test 
performed  to  demonstrate  that  design  reliability  specifications  have  been 
met.  Ideally  this  Is  a  formal  test,  conducted  under  strict  environmental 
and  operational  profile  conditions  with  maintenance  performed  In 
accordance  with  specified  access  or  repair  procedures.  In  many 
development  programs  for  nonelectronic  equipment,  qualification  testing 
Is  not  possible  simply  because  the  quantity  of  equipments  required  to 
perform  the  test  Is  not  available. 
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A  reliability  qualification  test  Is  Intended  to  provide  assurance 
that  minimum  acceptable  reliability  requirements  are  being  met  prior  to 
starting  production  of  the  equipment.  Qualification  tests  are  formal 
acceptance  tests  performed  In  an  operationally  realistic  environment  and 
are  statistically  designed  to  provide  estimates  of  reliability.  Formal 
procedures  for  conducting  qualification  tests  contain  a  description  of 
the  Item  to  be  tested,  the  equipment  operational  specification  and  a 
statistical  test  plan  with  accept/reject  criteria. 

Reliability  Is  a  time-dependent  parameter  and  there  Is  no  way  to 
verify  reliability  without  test  data  and  sufficient  testing  time  to 
establish  a  confidence  factor.  The  problem  with  designing  qualification 
tests  for  nonelectronic  equipment  Is  the  fact  that  specialized  designs 
limit  the  number  of  units  available  for  test.  MIL-STD-781  contains  some 
high  risk  test  plans  for  small  sample  sizes  but  very  often  only  one 
nonelectronic  equipment  Is  available  for  qualification  test.  The  problem 
Is  compounded  by  the  fact  that  each  nonelectronic  design  will  have  a 
multitude  of  operational  modes  and  all  design  requirements  can  not  be 
tested  simultaneously.  For  nonelectronic  equipment,  testing  time  must  be 
accumulated  from  piece  part  testing,  component  evaluation  tests  and 
whatever  sources  are  available.  The  key  to  using  this  data  for 
evaluating  nonelectronic  reliability  Is  the  maintenance  of  test  results 
as  a  source  of  engineering  data  for  such  time  dependent  parameters  as 
mechanical  wear,  crack  size  and  material  strength. 

A  clearly  defined  and  closely  monitored  reliability  qualification 
test  Is  a  necessary  requirement  at  the  completion  of  full  scale 
development.  It  must  be  remembered  by  the  procuring  activity,  however, 
that  nonelectronic  equipment  contains  time  dependent  failure  modes,  and 
It  may  not  be  possible  to  quantify  equipment  reliability  from  the  test 
results.  Qualification  testing  remains  a  necessary  part  of  a  test 
program  as  an  equipment  operational  test  prior  to  full  scale  production. 


The  procuring  activity  mutt  require  the  contractor  In  his  reliability 
program  plan  to  provide  estimated  testing  times  for  various  critical 
components  In  developing  qualification  test  procedures. 


The  other  reliability  accounting  test  as  described  In  HIL-STD-785  Is 
the  Production  Reliability  Acceptance  Test  (PRAT).  PRAT  Is  Intended  to 
simulate  In-service  evaluation  of  the  delivered  Item  or  production  lot. 
Because  of  the  limited  test  data  achievable  for  many  nonelectronic 
development  programs,  PRAT  can  be  very  useful  In  providing  estimates  of 
demonstrated  reliability.  The  same  problems  of  designing  test  plans  for 
qualification  test  with  small  sample  sizes  and  multi-functional  equipment 
applications  are  encountered  In  designing  a  PRAT  program. 


SECTION  4 
CONCLUSIONS 


Currant  military  standards  for  reliability  programs,  reliability 
predictions  and  qualification  testing  were  written  primarily  for 
electronic  equipment  where  component  standardization  and  the  valid 
assumption  of  an  exponential  failure  rate  permit  their  direct 
application.  Reliability  tasks  as  Included  In  MIL-STD-785  are  sometimes 
applicable  to  a  total  system  containing  both  electronic  and  nonelectronic 
designs.  The  reliability  of  the  nonelectronic  equipment  will,  however, 
be  much  more  dependent  upon  the  operational  environment  than  will 
electronic  equipment  because  of  the  more  direct  Interface  with  the 
operator  and  the  environment.  The  Individual  nonelectronic  equipments 
within  the  system  will,  therefore,  require  a  unique  approach  to  planning 
the  analysis  and  testing  program.  Small  sample  sizes  usually  available 
for  nonelectronic  equipments  and  their  multi-functional  operational 
characteristics  also  necessitate  a  unique  approach  to  planning  a 
reliability  program  for  nonelectronic  equipments  within  a  total 
electronic  system  and  totally  mechanical  systems. 

Reliability  analyses  for  nonelectronic  designs  such  as  a  failure 
rate  prediction  depend  to  a  large  extent  on  Internally  generated  fatigue 
and  component  life  test  data  because  published  falluro  rates  are  not 
generally  applicable  to  the  equipment  being  developed.  An  analysis  of  a 
nonelectronic  design  for  reliability  must,  therefore,  focus  upon  the 
location  of  overstressed  components.  The  FMECA  Is  the  most  powerful  tool 
for  evaluating  nonelectronic  reliability  and  should  be  applied  very  early 
In  the  design  program  for  use  In  Identifying  those  critical  areas  where  a 
stress  analysis  should  be  performed.  Early  application  of  the  FMECA  can 
eliminate  the  expense  of  performing  a  stress  analysis  for  all  parts  In 
the  design. 


hwmdinq.  Pioa  auMc-Nor  nui o 


\ . Ill'*;-  hKwm-  • 


Application  of  reliability  specifications  depends  upon  the  equipment 
being  designed  and  a  general  rule  of  applicability  for  nonelectronic 
equipment  Is  not  possible.  MIL-STD-785  states  that  a  reliability 
prediction  Is  generally  applicable  In  the  engineering  development  phase 
and  that  the  FMECA  is  selectively  applicable  In  the  concept  phase.  For 
nonelectronic  designs,  the  prediction  will  likely  be  delayed  until 
Internally  generated  testing  data  Is  available.  Meanwhile,  the  FMECA 
should  be  Initiated  very  early  In  the  development  program  to  Identify 
critical  failure  modes  and  corresponding  testing  requirements.  Typical 
application  of  these  and  other  reliability  tasks  for  nonelectronic 
development  programs  1$  shown  In  Figure  4-1, 

Nonelectronic  equipment  usually  dictates  a  testing  program  at  lower 
component  levels  than  does  electronic  equipment.  Fatigue  tests,  wear 
tests  and  other  evaluation  type  tests  must  often  be  performed  on 
Individual  piece  parts  as  part  of  the  development  effort.  Small  sample 
sizes  of  preoroductlon  equipments  will  necessitate  reliance  on  these 
design  test  results  to  provide  a  relative  Indication  of  total  equipment 
reliability  as  compared  to  similar  equipment  designs.  Procedures 
contained  In  MJL-STD-781  are  sometimes  not  appropriate  for  nonelectronic 
equipments  and  results  of  the  TAAF  program  combined  with  results  of 
engineering  development  tests  must  be  relied  upon  to  provide  an 
Indication  of  reliability. 

Another  example  of  the  difference  In  application  of  reliability 
specifications  to  electronic  and  nonelectronic  development  programs  Is 
the  preparation  of  Environmental  Stress  Screening  (ESS)  procedures, 
MIL-STD-785  states  that  ESS  Is  selectively  applicable  to  the  validation 
phase  and  generally  applicable  to  the  full  scale  engineering  development 
phase.  For  nonelectronic  equipment  such  requirements  will  not  generally 
be  applicable  to  the  validation  phase  and  only  selectively  applicable  to 
the  full  scale  development  phase. 
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TABU  4-1.  TYPICAL  APPLICATION  OF  RELIABILITY  TASKS  TO  NONELECTRONIC 
DEVELOPMENT  PROGRAMS 


TASK 

PROGRAM PHAN 

TYPE 

CONCEPT 

VALID 

PEED 

PROD 

RELIABILITY  PROGRAM  PLAN 

MOT 

B 

B 

• 

• 

MONITORFCONTROl  OP  IUBCONTRACTORI 
ANDSUPPLIERI 

MOT 

a 

S 

• 

a 

PROGRAM  REVIEW! 

MOT 

B 

• 

G 

0 

FAILURE  REPORTING,  ANALYtlt,  AND 
CORRECTIVE  ACTION  EYSTIM  (FRACAS) 

ENG 

NA 

B 

Q 

0 

FAILURE  REVIEW  BOARD  (PRfll 

MOT 

NA 

B 

0 

0 

RELIABILITY  MODELING 

ENG 

S 

E 

0 

G 

RELIABILITY  ALLOCATIONS 

ACC 

B 

E 

0 

GO 

RELIABILITY  PREDICTIONS 

ACC 

B 

S 

B 

0 

FAILURE  MODES,  EFFECTS,  AND 

CRITICALITY  ANALYSIS  IPMECAI 

ENG 

0 

0 

0 

GO 

SNEAK  CIRCUIT  ANALYSIS  (ECA) 

ENG 

NA 

NA 

NA 

NA 

ELECTRONIC  PARTS/ClRCUITE 

TOLERANCE  ANALYSIS 

INO  1 

NA 

NA 

NA 

NA 

PARTE  PROGRAM 

ENO 

NA 

NA 

a 

B 

RELIABILITY  CRITICAL  ITEMS 

MOT 

B 

1 

a 

0 

EVPBCTBOP  FUNCTIONAL  TEBTINO, 

ENG 

NA 

» 

0 

oc 

BYORAOI,  HANDLING,  PACKAGING, 
TRANIPORT  ATION,  AND  MAINTENANCE 

BNVIRONMINTAl  STRISI  10RMNINO  Hill 

RELIABILITY  DIVILOPMENT/GROWYH 
TUTINO  INOTi  II 

RELIABILITY  QUALIFICATION  TUT 
IRQTI  PROGRAM 

PRODUCTION  RELIABILITY  ACCEPTANCE 
TBIT  IPRATI  PROGRAM 


Cuirf  DEFINITION* 


TABU  TYPE 

ACC  -  RELIABILITY  ACCOUNTING 
ING  -  RELIABILITY  t  UQINEIRINO 
MOT  -  MANAGEMENT 


PROGRAM  PHASE 

S-  SELECTIVELY  APPLICABLE 
0-  OINIRALLV  APPLICABLE 
C-  APPLICABLE  AT  COMPONENT  LEVEL 
OC-OSNI RALLY  APPLICABLE  TO  OIBION 
CHANGES  ONLY 
NA-NOT  APPLICABLE 


NOT*  l!  ALSO  KNOWN  AS  TEST  ANALYZE  AND  FIX  <TAAF) 
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As  Indicated  In  Table  4-1,  there  are  no  specific  rules  for  applying 
reliability  tasks  to  nonelectronic  development  programs.  Until  such  time 
that  specific  reliability  specifications  are  prepared  for  the  analysis 
and  testing  of  nonelectronic  equipment,  the  generation  of  analysis  and 
testing  plans  unique  to  the  nonelectronic  equipment  under  development 
will  be  required. 
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